Re: kylin sso配置

2017-05-08 Thread Li Yang
http://kylin.apache.org/docs20/howto/howto_ldap_and_sso.html Does this help? 2017-05-02 15:18 GMT+08:00 : > > 我想问一下,如何配置 kylin基于cas实现sso > >

Re: where is the source code kylin-2.0.0-hbase1x

2017-05-13 Thread Li Yang
The tag "2.0.0" is now based on hbase 1.x by default. https://github.com/apache/kylin/tree/kylin-2.0.0 On Fri, May 5, 2017 at 3:03 AM, Alberto Ramón wrote: > This can help you: (in 2.0 the branch system ans been changed) > > https://issues.apache.org/jira/browse/KYLIN-2413 > > On 4 May 2017 at 0

Re: BadQueryDetector (Please ignore the last post)

2017-05-13 Thread Li Yang
My impression is, when connecting live, Tableau will "select * from" DIMENSION table. And that is affordable. Tableau shall never "select * from" the FACT table. Could you verify? On Tue, May 9, 2017 at 1:59 PM, Billy Liu wrote: > Have you checked the “Direct Mode” on Tableau? Have you asked for

Re: How do I deploy kylin when I have a Hadoop environment!

2017-05-13 Thread Li Yang
http://kylin.apache.org/docs20/install/index.html On Tue, May 9, 2017 at 12:46 PM, John.xiong <1183744...@qq.com> wrote: > Dear Dev: > >How do I deploy kylin when I have a Hadoop environment!Please give > me a plan and suggestion。 > > > > >My Hadoop environment: > > hadoop versio

Re: Document that explain how Kylin query, indexing, metadata engine works

2017-05-14 Thread Li Yang
No for now I believe. You can help by creating JIRAs to mark these tasks, better in small topics, and community will work them out. On Fri, May 12, 2017 at 6:09 AM, Nirav Patel wrote: > I see there are documents that explains how kylin ingest hive tables and > build cubes/cuboids using MR and/or

Fwd: Review patch

2017-05-14 Thread Li Yang
Forward to dev for wider audience. -- Forwarded message -- From: Alberto Ramon Date: Sat, May 13, 2017 at 5:32 AM Subject: Review patch To: Li Yang Hi, I made 3 new manuals about Apache Kylin Some body can review this patch <https://drive.google.com/open?id=0B-6n

Re: REST APIs for Create/Update models and cubes and selecting datasources

2017-05-14 Thread Li Yang
There is no public stable RESTful API to create cube programmatically. However there is one API that Kylin GUI uses to create cube, and in the debug console of modern browser, advanced user can observe how this API works. But note, it is not a stable API and is subject to change from version to ve

Re: BadQueryDetector (Please ignore the last post)

2017-05-14 Thread Li Yang
Could any one provide more details to reproduce this problem? At least I didn't spot "select * from fact" when using Tableau+Kylin. Cheers Yang On Sun, May 14, 2017 at 10:31 AM, 赵天烁 wrote: > we have the same issue > > > > 来自 赵天烁的 魅族 MX > > > > ---

Re: BadQueryDetector (Please ignore the last post)

2017-05-26 Thread Li Yang
leau will send a select * query > without any limit clause to list all the column value for you to choose > from.and that is where it cause this problem. > > > > 来自 赵天烁的 魅族 MX > > > > 原始邮件 > 发件人:Li Yang > 时间:周日 5月14日 17:01 > 收件人:dev@kylin.apache.

Re: Do kylin create any indexes against cubes data

2017-05-26 Thread Li Yang
Kylin Cube leverage HBase rowkey index to speed up query, and also limited by it in some sense. That is why in the cube "Advanced Settings", user may want to fine tune the dimensions order on the rowkey in some cases. Cheers Yang On Tue, May 16, 2017 at 5:18 AM, Nirav Patel wrote: > When genera

Re: Do kylin cache cube/segment data elsewhere other then hbase

2017-05-26 Thread Li Yang
All cube data are in HBase now. HBase mem cache helps to keep recently used cube in memory. On Tue, May 16, 2017 at 5:21 AM, Nirav Patel wrote: > Do kylin stores cube data anywhere apart from hbase currently? Does it > maintain in-memory or cache of say latest data which can be queried faster >

Re: [20170327] Apache Kylin 1.5 version & Tableau desktop on Mac machine compatibility

2017-05-26 Thread Li Yang
Not as I know... and help in this domain are very appreciated. On Mon, May 15, 2017 at 1:55 PM, guru prasath < prasath_sax...@yahoo.co.in.invalid> wrote: > Hello Kylin Team , > > Good afternoon . > > 1. Do you have any plans for releasing Kylin odbc driver that supports on > Mac for using Tablea

Re: Some questions of Cube segment

2017-05-26 Thread Li Yang
Two approaches. 1) is simply keep all dimensions for one year, if you can afford the storage. Simpler solution is worth a little additional cost. 2) or you can create two cubes. One cube contains only year and month and the retention is one year. Another cube contains year/month/day/hour and the

Re: Cubesegment merge error

2017-05-26 Thread Li Yang
Briefly looked the related code, it is not obvious why this could happen. Could this reproduce after reboot Kylin server? On Fri, May 19, 2017 at 1:53 PM, elicer wrote: > I think this issue may related to one of the field only have empty value , > but this field is one of the include fields i

Re: Serveral Things

2017-05-26 Thread Li Yang
Thanks Alberto. Kylin can already run in doctor and in cloud. There maybe some missing documents to catch up. As to the 300 MB limit, that is a point to improve. With many options, like load only needed columns, use more compatible memory format, or simply raise the 300 MB bar. On Tue, May 23, 20

Re: [jira] [Created] (KYLIN-2648) Encounter cube merge error when deploy kylin on stand alone hbase cluster

2017-05-26 Thread Li Yang
Maybe update kylin.properties with below can workaround? kylin.env.hdfs-working-dir=hdfs://cdh5-mini/kylin On Fri, May 26, 2017 at 1:57 PM, suheng.cloud (JIRA) wrote: > suheng.cloud created KYLIN-2648: > --- > > Summary: Encounter cube merge error w

Re: build error

2017-06-02 Thread Li Yang
I start to suspect this is because Kylin 2.0 is compiled with hadoop 2.7 while Kylin 1.6 is compiled with hadoop 2.6. Could you confirm your hadoop version and JDK version? Thanks Yang On Sun, May 28, 2017 at 10:28 PM, qiumingming wrote: > Have you solved this error, I got a similar error when

Re: [jira] [Created] (KYLIN-2648) Encounter cube merge error when deploy kylin on stand alone hbase cluster

2017-06-02 Thread Li Yang
Let's avoid due post and keep discussion in JIRA. Thanks. Yang On Mon, May 29, 2017 at 2:52 PM, suheng.cloud wrote: > Hi, shaofeng & yang > I try to modiry property "kylin.env.hdfs-working-dir" to full qualified > path > " hdfs://cdh5/kylin-83-hadoop", > and found it can't work around. > The e

Re: The coprocessor thread stopped itself due to scan timeout or scan threshold(check region server log), failing current query

2017-06-02 Thread Li Yang
The region server has scanner too many rows or for too long and aborted itself. How many powerful is your hbase cluster? And what cardinality of fdz is? On Fri, Jun 2, 2017 at 11:15 AM, 35925138 <35925...@qq.com> wrote: > 在查询cube时,遇到如下错误,可能会是哪方面的原因Error while executing SQL "select > count(distin

Re: build error

2017-06-12 Thread Li Yang
Yes, internal comments are good for us to collaborate. On Sat, Jun 3, 2017 at 5:31 PM, qiumingming wrote: > Can you see my comments at https://issues.apache.org/ > jira/browse/KYLIN-2654. > The website said my comments are internal and only be visible to agents and > collaborators. If you can no

Re: The coprocessor thread stopped itself due to scan timeout or scanthreshold(check region server log), failing current query

2017-06-12 Thread Li Yang
Most likely it is hbase performance issue. You can verify by scanning the KYLIN_XXX htable directly in hbase shell. On Tue, Jun 6, 2017 at 9:43 AM, 35925138 <35925...@qq.com> wrote: > fdz的基数没有多少,几百个最多了。 > > > > > -- 原始邮件 ------ > 发件人: "

Re: Kylin2.0.0在Spark模式下报Class未注册的问题

2017-06-12 Thread Li Yang
Billy really loves coding... just cannot help it. ;-) On Tue, Jun 6, 2017 at 10:20 AM, Billy Liu wrote: > This is known issue. Could you try the latest code on the master branch? It > should be fixed already. > https://issues.apache.org/jira/browse/KYLIN-2592 > > 2017-06-06 10:00 GMT+08:00 凡梦星尘

Re: Question on many-to-many relationship in snowflake model

2017-06-18 Thread Li Yang
You could have two models like below: - Model 1: just the fact table - Model 2: the fact table JOIN the city table Kylin will choose the right model based for every query. If the query goes like "select from fact_table group by ", then Model 1 will be chosen. If the query goes like "selec

Re: Kylin go to hdfs to find jar file

2017-06-28 Thread Li Yang
Need full kylin.log to pin down the root cause. Especially the part when the MR job is submitted. On Mon, Jun 12, 2017 at 11:38 AM, KevinLei wrote: > Hi Billy, > > I have the similar issue. Could you please help on this? > > Here is the output error info: > > java.io.FileNotFoundException: File

Re: kylin odbc connect powei bi error

2017-06-28 Thread Li Yang
Try describe the problem in detail that others can reproduce. Or people cannot help. On Mon, Jun 12, 2017 at 4:52 PM, cong.xi...@hand-china.com < cong.xi...@hand-china.com> wrote: > > when i use kylin odbc connect powei bi ,occuring error > note:kylin version 1.6, kylin odbc driver v1.6 > > > >

Re: File not found error at step 2 in yarn logs

2017-06-28 Thread Li Yang
Kylin sends metadata as distributed cache of MR job. The missing file "file:/home/q/hadoop/kylin/tomcat/temp/kylin_job_meta3892468167792432608/meta" should be prepared on machine B and D before YARN kicks off mappers. As to why the files were not there I don't know. On Wed, Jun 14, 2017 at 12

Re: Cubesegment merge error

2017-06-29 Thread Li Yang
Unless all values in that column is null. That may be special case where the dictionary is not created at all, thus causes the NPE. On Wed, Jun 14, 2017 at 4:33 PM, elicer wrote: > Yes, It is still there. > > Are there any instructions or limitations for the dimension field during > the > cube m

Re: Creating Snowflake schema / Link 2 Cubes

2017-06-29 Thread Li Yang
We could create multiple models and cubes like - Model 1: Book (alone) - Model 2: Author (alone) - Model 3: Book join Author Depending on the incoming query, Kylin will choose the right model with best performance. On Tue, Jun 13, 2017 at 12:23 PM, LeReunionais wrote: > > I see that in Bart'

Re: JARs in Hadoop 3.0

2017-06-29 Thread Li Yang
yeah, a good news~~ common jars like guava will be much easier to handle. On Sun, Jun 18, 2017 at 7:55 AM, Alberto Ramón wrote: > Could be this useful to avoid problems with JAR? > or when HBase is in other cluster > > https://issues.apache.org/jira/browse/HADOOP-11804 >

Re: No of arguments passing issue in kylin query

2017-06-29 Thread Li Yang
Not a known issue.. What is your Kylin version? On Thu, Jun 22, 2017 at 5:16 PM, suresh m wrote: > forgot to add 2nd query. > > SELECT AL_PROD.CLNDR_DT, AL_PROD.TRIP_NAME, AL_PROD.ROUTE_NAME, > AL_PROD.DRIVER_NAME,AL_PROD.TOT_DIS_COV, AL_PROD.REGN_NUMBER FROM (SELECT > AL_TIME_DIM.CLNDR_DT,AL_T

Re: why all my cube status change to DESCBROKEN after reload metadata?

2017-06-29 Thread Li Yang
This is typically because Table / Cube inconsistency. E.g. a field referenced in cube does not exist on table any more. On Fri, Jun 23, 2017 at 11:13 AM, 赵天烁 wrote: > RT,after I execute metadata reload through REST API,all my > cube status change to DESCBROKEN as follow. > all query send to

Re: Access Control in Project-Level and Cube-Level

2017-06-29 Thread Li Yang
We could use a document here... https://issues.apache.org/jira/browse/KYLIN-2697 On Mon, Jun 26, 2017 at 3:45 PM, Chu Zhen wrote: > Hi All, > There are two access grant page in Kylin Web Client: > 1. In Project Page(kylin/projects), access tab for every project. > 2. In Cube Page(/kyl

Re: errors when run StorageCleanupJob

2017-06-29 Thread Li Yang
A known issue, is fixed on master branch. Thanks for reporting! On Wed, Jun 28, 2017 at 10:16 AM, zhongyuhai <199526...@qq.com> wrote: > hello > > > when I run command as follow > > > kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true > > > and I got the exception msg as follow : > >

Re: Execute SQL on Kylin 2.0.0 with old metadata

2017-06-29 Thread Li Yang
The metadata is backward compatible by design. Smooth upgrade is expected. On Thu, Jun 29, 2017 at 3:13 PM, skyyws wrote: > Hello, > > If I build the segments with kylin 1.5.4, and now I want to deploy kylin > 2.0.0. Can I execute SQL on kylin 2.0.0 with old metadata url > directly(which means

Re: I encountered a problem while querying data with kylin's Restful Api

2017-07-10 Thread Li Yang
The date constants should lead by a 'date' keyword, like date '2012-08-01'. For example, the above query should rewrite as: select sum(a.price), a.PART_DT from KYLIN_SALES a where a.PART_DT< *date '2012-08-01'* group by a.PART_DT On Fri, Jun 30, 2017 at 4:02 PM, 华梦真 wrote: > Hi , > I used k

Re: kylin when case

2017-07-12 Thread Li Yang
Seems like a bug, please open a JIRA to track. Also please share complete error log to debug. On Mon, Jun 26, 2017 at 11:27 AM, snail_wjk wrote: > 在kylin2.0.0中我使用如下语句会报错,但是在kylin1.6.0中就可以执行成功。 > select "MAIN_ORDER_VIEW"."CHANNEL_ID" as "c0" from "MAIN_ORDER_VIEW" as > "MAIN_ORDER_VIEW" group by

Re: consultation for kylin2.0 parameters

2017-07-12 Thread Li Yang
When turned on, kylin tries to grow an existing dictionary instead of creating new dictionaries. However, as tested, this hurts performance in some cases, and because memory is usually sufficient to load many dictionaries, this flag is off by default. Yang On Wed, Jul 5, 2017 at 11:34 AM, 仇同心 wr

Re: Ask for help, to help look at this problem

2017-07-14 Thread Li Yang
Also repeat my comment here: This is expected. The query "select *" asks for all dimensions. And the first cube "cube0615new_one" does not have all required dimensions and is skipped. Makes sense to me. On Fri, Jul 7, 2017 at 12:06 PM, ShaoFeng Shi wrote: > I'm afraid "select * " query is not a

Re: Issues running DebugTomcat.java from non sandbox environment

2017-07-14 Thread Li Yang
Currently DebugTomcat only works with HDP sandbox. However it is possible to make it work with other hadoop env. The hadoop config DebugTomcat uses resides in "examples\test_case_data\sandbox". Put all necessary Hadoop site xmls there and it should connect to any Hadoop env you want. Cheers Yang

Re: Query Metadata

2017-07-14 Thread Li Yang
Good information! On Sun, Jul 9, 2017 at 9:21 AM, Alberto Ramón wrote: > HUE 1.12 and Kylin 1.6.0, works (no path is needed): > [image: Inline images 1] > > > But have an exception: > An error occurred while calling o.execute. : java.sql.SQLException: > Error while executing SQL "*SHOW DATAB

Re: run kylin error

2017-07-17 Thread Li Yang
Your email setting is very strange. Replying often get rejected. Please correct. "This email claims to come from qq.com, but replies will go to an email address at another domain. Be careful with this message. Learn more" On Sun, Jul 9, 2017 at 6:10 PM, 1820983...@qq.com <1820983...@qq.com> wr

Re: kylin2.0 hdp2.5 start failed

2017-07-17 Thread Li Yang
Your email setting looks strange. Suggest correct it first. "This email claims to come from qq.com, but replies will go to an email address at another domain. Be careful with this message." On Sun, Jul 9, 2017 at 10:44 PM, 1820983...@qq.com <182

Re: FW: Sample Cube Exception

2017-07-17 Thread Li Yang
Hadoop env problem. Suggest using a popular hadoop distribution like CDH or HDP, or such Hadoop issue could haunt for days. On Mon, Jul 10, 2017 at 3:19 PM, wrote: > Hi > While I trying to create a cube following the exmple tutorial, I got the > following exception, any one knows why this is hap

Re: Kylin for MapR

2017-07-17 Thread Li Yang
I knew some commercial version of Kylin could store metadata and cube outside of HBase. On Tue, Jul 11, 2017 at 5:19 AM, Nirav Patel wrote: > "Please also note that Kylin's metadata is persisted to HBase by default, > you need have another implementation for ResourceStore." > > I found almost 60

Re: Query without HBase corprocessor

2017-07-17 Thread Li Yang
Not at the moment. HBase coprocessor is mandatory for Kylin. (Although I knew some commercial version of Kylin makes HBase optional, that's a different story.) On Wed, Jul 12, 2017 at 2:11 PM, wrote: > Hi > > Is it possible to query without using HBase coprocessor? > > I’m running kylin on MapR,

Re: Kylin taking too much time

2017-07-18 Thread Li Yang
The step 1 is actually a hive command that Kylin triggers. You need to investigate why that hive command takes so long to complete. Looking at YARN console is usually the first step. Cheers Yang On Thu, Jul 13, 2017 at 9:20 AM, bhanuprakash k wrote: > Hello > >I have 4 machines running in a

Re: Kylin is unable to find KYLIN_CONF

2017-07-20 Thread Li Yang
Kylin does not requires KYLIN_CONF to work. KYLIN_CONF is only used for internal debug, not something user should worry. On Sun, Jul 16, 2017 at 12:38 AM, 刘俊 wrote: > > Hi > It seems that Kylin is not able to read env variable KYLIN_CONF. > I tried to set it in .bashrc file or explicitly set KYL

Re: build cube error

2017-07-22 Thread Li Yang
You need to build the cube, which loads data into cube, before it can serve queries. On Thu, Jul 20, 2017 at 10:12 AM, Li Feng wrote: > Hi, > > This may due to metadata disruption ,try to purge the cube and build again. > > BR, > Lee. > > 发件人: "apache_...@163.com" > 答复: "dev@kylin.apache.org"

Re: Unable to see the jobs failed on the monitor page.

2017-07-22 Thread Li Yang
Could you check any exception in log when the monitor page is displaying? There was report that lost or broken job output can hinder monitor page. https://issues.apache.org/jira/browse/KYLIN-2711 Cheers Yang On Thu, Jul 20, 2017 at 11:52 AM, Billy Liu wrote: > Could you reproduce this issue on

Re: Cube view

2017-07-25 Thread Li Yang
No such plan yet. Please create a JIRA and describe the requirement in more details if you think it is important. Thanks! Yang On Fri, Jul 21, 2017 at 12:33 PM, apache_...@163.com wrote: > Hi, > > Sometime,the Cube result must share some departments,department can only > access part of cube co

Re: New blog "Improving Spark Cubing in Kylin 2.0"

2017-07-25 Thread Li Yang
Bravo Kaisen! 赞 Kaisen! On Sat, Jul 22, 2017 at 12:32 PM, ShaoFeng Shi wrote: > Hello Kyliner, > > The blog "Improving Spark Cubing in Kylin 2.0" from committer Kangkai Sen > is published in Kylin website today. For the users who are interested about > Spark + Kylin, it can help: > > https://kyl

Re: kylin service has collapsed frequently

2017-07-30 Thread Li Yang
No obvious reason in log Check out "kylin.out". There could be some clues. On Tue, Jul 25, 2017 at 11:18 AM, wangke wrote: > hi all, > > Recently my kylin service has collapsed frequently. Can you help me analyze > the reasons. > Please see the attachment for more details > > -- > Best re

Re: kylin数据迁移的时候遇到的问题

2017-07-30 Thread Li Yang
Sorry, there is missing information is the received email. Try send in a more text-ful format. Without images for example. 2017-07-25 16:32 GMT+08:00 lh...@cndatacom.com : > 在执行数据迁移的时候出现了下面的错误。 > -- > lh...@cndatacom.com >

Re: CDH Hbase on S3

2017-07-30 Thread Li Yang
Regarding cube storage, Kylin relies on HBase not on S3. So the question would better be: Is HBase on S3 a feasible solution? And I think the answer is definitely yes. You can run HBase on S3 for sure. What is not sure is the performance downgrade due to the degraded data locality... which I don't

Re: build demo project error with hive

2017-08-01 Thread Li Yang
It should be some problem in Step 1 or Step 2, where a intermediate hive table is created. Check the logs of previous step. On Thu, Jul 27, 2017 at 11:29 AM, Copperfield wrote: > I use the beeline as the Hive Cli, but i read the former mail i got that at > step 3, kylin use hcatlog to get hive t

Re: kylin service has collapsed frequently

2017-08-05 Thread Li Yang
catc1484739667844645 and flag=1 > ", isn't good for Kylin check Kylin 1792 > <https://issues.apache.org/jira/browse/KYLIN-1792> v1.5.3and this mailList > > On 30 July 2017 at 20:40, Li Yang wrote: > > > No obvious reason in log Check out "kylin.out&q

Re: and method edit exist model

2017-08-06 Thread Li Yang
Clone a model and edit it, create cube under it, build the new cube. When new model / cube is stable, remove or disable the old mode / cube. Coexisting of similar models and cubes are also fine. Kylin will pick the cube which performs better of a certain SQL. Cheers Yang On Mon, Jul 31, 2017 at

Re: How can I edit model & cube?

2017-08-06 Thread Li Yang
Try google. This is answered before. http://apache-kylin.74782.x6.nabble.com/Re-REST-APIs-for-Create-Update-models-and-cubes-and-selecting-datasources-td7947.html On Wed, Aug 2, 2017 at 9:28 PM, apache_...@163.com wrote: > > > > > These problems have now been sorted > > > thinks. > > > > > > >

Re: ql often running error

2017-08-06 Thread Li Yang
By analyze kylin.log... On Thu, Aug 3, 2017 at 5:24 PM, apache_...@163.com wrote: > Hi, > > sql does often running error,but after restart kylin server, > SQL can execute properly > > How do I find out the reason? > > > > > -- > apache_...@163.com > >

Re: sql often running error

2017-08-06 Thread Li Yang
The root cause should be last exception above the [QUERY] section. Check there. On Thu, Aug 3, 2017 at 5:50 PM, apache_...@163.com wrote: > > > Maybe the picture cannot be displayed > > log : > > 2017-08-03 17:57:00,875 INFO [Query 440deaab-b8ee-4c0c-887e-2dd5982fcf8f-176] > service.Q

Re: How to migrate cube from one Kylin to another (for example, Kylin QA to Kylin Production) within the different Hadoop Cluster

2017-08-06 Thread Li Yang
Rebuild the cube in new cluster is often easier. On Thu, Aug 3, 2017 at 8:29 PM, ShaoFeng Shi wrote: > Kylin metadata migration is very simple, just follow the "backup/restore > metadata" guide. > > But if you want to have the Cube data also be moved to new cluster, you > need migrate: > > 1) Hi

Re: [VOTE] Release apache-kylin-2.1.0 (RC1)

2017-08-06 Thread Li Yang
+1 mvn test passed java version "1.7.0_95" OpenJDK Runtime Environment (rhel-2.6.4.0.el6_7-x86_64 u95-b00) OpenJDK 64-Bit Server VM (build 24.95-b01, mixed mode) On Sat, Aug 5, 2017 at 6:37 PM, ShaoFeng Shi wrote: > Hi all, > > I have created a build for Apache Kylin 2.1.0, release candidate

Re: Dictionary not found

2017-08-15 Thread Li Yang
Hard to troubleshot from the description. Is there a way to reproduce the problem using sample cube? On Wed, Aug 2, 2017 at 11:47 PM, bk_180 wrote: > Hi all, > > We have a cube that needs to get two partitions refreshed, so we run one > job > to refresh the first partition and then run other job

Re: [DISCUSS] On removing Cube ACL

2017-08-15 Thread Li Yang
So we can still control who can (or cannot) access a cube by defining ACL on tables, right? On Mon, Aug 7, 2017 at 2:26 PM, ShaoFeng Shi wrote: > It makes sense for me. Will the Cube ACL info be migrated (from Cube to > Table) when it is done? > > 2017-08-07 10:37 GMT+08:00 hongbin ma : > > > Cu

Re: The REST query request failed

2017-08-15 Thread Li Yang
This is known issue https://issues.apache.org/jira/browse/KYLIN-2787 Thanks for reporting. Yang On Tue, Aug 8, 2017 at 3:53 PM, shendandan wrote: > Hello! > I use tableau as kylin's visualization tool. And I want to know can I > create calculated field in tableau to select? > " if [还款

Re: How to migrate cube from one Kylin to another (for example, Kylin QA to Kylin Production) within the different Hadoop Cluster

2017-08-15 Thread Li Yang
Then pls following Shaofeng's answer. On Tue, Aug 8, 2017 at 4:51 PM, wangzy24 wrote: > Not to do the whole data migration, it is iterative development, the demand > upgrade, the part of the metadata that we want to migrate, what could be > the > solution? > > > > shaofengshi wrote > > Kylin met

Re: Kylin 主从同步经常失败

2017-08-15 Thread Li Yang
pls provide more info or people cannot help On Tue, Aug 8, 2017 at 3:12 PM, lichaojacobs wrote: > I am sure it's not the network problem. Because some changes can > successfully > send to other nodes. > So, I think it's the program sometimes can not reponse status with 200, > perhaps 500. But th

Re: Kylin often hangs up

2017-08-19 Thread Li Yang
> 2017-08-10 10:14:35,013 WARN [localhost-startStop-1-EventThread] client.HConnectionManager$HConnectionImplementation:2468 : This client just lost it's session with ZooKeeper, closing it. It will be recreated next time someone needs it org.apache.zookeeper.KeeperException$SessionExpiredException:

Re: [BadQueryDetector] service.BadQueryDetector:169 : Problemat ic thread 0x151

2017-08-19 Thread Li Yang
The service outage is not expected, it could be slow but not outage. > where hotel <> 'A' and hotel = 'A' However this deserves a JIRA to optimize for the "always false" condition. Please log a JIRA. On Mon, Aug 14, 2017 at 4:58 PM, wangzy24 wrote: > When conditions are mutually exclusive in

Re: how to get jobid

2017-08-19 Thread Li Yang
Good point. JIRA logged. https://issues.apache.org/jira/browse/KYLIN-2795 On Mon, Aug 14, 2017 at 7:27 PM, 为岁月留白 <215521...@qq.com> wrote: > All of public job RESRAAPI new use jobid,but didn't have API to get > jobid,so,how to get the jobid.

Re: Get data from bigint column error

2017-08-19 Thread Li Yang
What is your Kylin version? I think a similar issue was reported so it is likely fixed in latest 2.1 release. Mind test it again on 2.1? On Tue, Aug 15, 2017 at 3:42 PM, jimmy wrote: > Hi, > > > > I want to get data from kylin sample data. > > But,It return error message. > > > > SQL: > > > > se

Re: [DISCUSS] On removing Cube ACL

2017-08-19 Thread Li Yang
t 11:59 PM, Luke Han wrote: > Data Model level is better than Cube level. > > How about to leave extend point there for people who want to keep Cube > Level ACL? > > > > > Best Regards! > - > > Luke Han > > On Tue, Aug 15, 2017 at 5:

Re: [DISCUSS] On removing Cube ACL

2017-08-19 Thread Li Yang
(correct) So it does not *simplify *anything. A clear removal is still preferred, in my opinion. On Sun, Aug 20, 2017 at 1:16 PM, Li Yang wrote: > I think we are looking for a clear attitude here. Leaving an extension > point is the same to say "cube level ACL shall be kep

Re: Subquery cann't work

2017-08-19 Thread Li Yang
Seems a bug to me. Please log a JIRA. On Thu, Aug 17, 2017 at 10:17 AM, apache_...@163.com wrote: > Hi, > > There seems to be a problem with sql parsing engine? please confirm > > This Sql can work. > > SELECT T8_0.*, T8_0.Ieceb82a4498247aeb911ba59f82148f0 - T8_1. > Ieceb82a4498247aeb911ba59f82

Re: an error occurred when build cube at step 6:create HTable

2017-08-20 Thread Li Yang
First there is issue with your HBase. You have to fix that first. Verify by creating new HTable. After HBase is back, discard the error job in Kylin and rebuild the cube again. Kylin should back to normal. On Fri, Aug 18, 2017 at 5:39 PM, 863109...@qq.com <863109...@qq.com> wrote: > > Hello ever

Re: LAST_DAY function?

2017-08-20 Thread Li Yang
often I see joining a lookup table to get the month-begin and month-end of a date. On Sat, Aug 19, 2017 at 11:32 PM, apache_...@163.com wrote: > Hi, > >There are a lot of surprises in kylin 2.1 version.It's amazing. > > >Ask a question: > > What functions can be used to calculate

Re: Re: Subquery cann't work

2017-08-30 Thread Li Yang
Thanks for confirming kylin 2.1 does not have this problem. On Sun, Aug 20, 2017 at 9:12 PM, apache_...@163.com wrote: > Thinks . > > This issue not found in kylin v2.1. > > > > apache_...@163.com > > From: Li Yang > Date: 2017-08-20 14:31 > To: dev > Subject

Re: Project Level ACL

2017-08-30 Thread Li Yang
I'm copying the suggestions to KYLIN-2760. Discussion can go on there. On Tue, Aug 22, 2017 at 4:04 AM, Alberto Ramón wrote: > About Kylin 2760 (https://issues.apache.org/jira/browse/KYLIN-2760) > > I propose small change: > >- Only system admin can create and see connection strings >- T

Re: how to get jobid

2017-08-30 Thread Li Yang
There is JIRA KYLIN-2795 on this. I'm seeing if any one can help. On Fri, Aug 18, 2017 at 5:50 PM, jandi...@aliyun.com wrote: > Hi, >i got a problem, when i programming to monitor the status of a cube > during the period of building, i don't know how to get the jobid? I have > checked the

Re: About kylin ACL

2017-08-30 Thread Li Yang
The ADMIN can grant permission to the MODELER at project level. After creating the new project. On Tue, Aug 22, 2017 at 4:26 PM, yu feng wrote: > In kylin, we have three role: ADMIN/ MODELER and ANALYST > > I find only ADMIN have Permission to create new project, But as a new > normal MODELER u

Re: Unknown exception. Jdbc operation attempted: MIX_JdbcCatalog_execTables

2017-09-03 Thread Li Yang
The direct cause is Kylin JDBC ResultSet does not support the previous() operation. Is there any way to workaround in MSTR avoiding calling previous()? Or maybe try connect via ODBC. On Tue, Aug 22, 2017 at 5:53 PM, alantt wrote: > Hello! > > Kylin 2.0 > JDBC 2.0 > Microstrategy 10.4 Linux > >

Re: SQL execute failed when use CASE in where clause

2017-09-03 Thread Li Yang
This looks like a bug. Please log a JIRA. Thanks for reporting! On Thu, Aug 24, 2017 at 8:44 PM, skyyws wrote: > Sorry for my mistake. It should be "use CAST in where clause" not "CASE" > > 2017-08-24 > > skyyws > > > > 发件人:"skyyws" > 发送时间:2017-08-24 20:41 > 主题:SQL execute failed when use CASE

Re: HDP-2.6.1 virtualbox sandbox DebugTomcat error

2017-09-03 Thread Li Yang
Haven't tried hdp-2.6. Most Kylin developers are on hdp-2.4 as far as I know. On Thu, Aug 24, 2017 at 9:56 AM, jun <1063489...@qq.com> wrote: > hi, all > I use hdp-2.6.1 sandbox to run IDEA DebugTomcat.java, and when I build > cube, it get errors: > > 2017-08-23 08:50:01,016 WARN [pool-6-th

Re: How to get a job status?

2017-09-03 Thread Li Yang
Guosheng is working on https://issues.apache.org/jira/browse/KYLIN-2795 The document will be updated soon. On Mon, Aug 28, 2017 at 12:02 PM, apache_...@163.com wrote: > Hi, > >I run a cube by api(/kylin/api/cubes/{cubeName}/build), It's daily > task。 > >How do I get the status job info

Re: How to set timezone in JDBC parameter?

2017-09-03 Thread Li Yang
This is a common problem when converting Java dates to/from SQL dates. It can be resolved by correctly setting the time zone at JDBC API calls. Following is the answer from Julian from the Apache Calcite community: "Calcite is implementing the SQL standard, which says that date-time values have n

Re: perdue cube

2017-09-03 Thread Li Yang
We do not recommend creating mode/cube using API as they are not public according to Kylin document. To fix your inconsistent metadata, try export all, manual edit the JSON files, and import back. http://kylin.apache.org/docs21/howto/howto_backup_metadata.html On Tue, Aug 29, 2017 at 8:38 PM, 为岁

Re: count_distinct_if, count_if and sum_if

2017-09-03 Thread Li Yang
Kylin does not support FILTER clause as of 2.1 On Wed, Aug 30, 2017 at 3:06 PM, Julian Hyde wrote: > Are you aware of the FILTER clause? I believe that COUNT_DISTINCT_IF(x, b) > is equivalent to COUNT(DISTINCT x) FILTER(WHERE b). And similarly COUNT_IF > and SUM_IF. > > FILTER has been in Calcit

Re: count_distinct_if, count_if and sum_if

2017-09-03 Thread Li Yang
@Alex, support of the FILTER clause or the count_distinct_if() will be more complicated than you think. It is not just about measure type. You can open a JIRA and collaborate there. On Sun, Sep 3, 2017 at 7:12 PM, Li Yang wrote: > Kylin does not support FILTER clause as of 2.1 > > On

Re: Can't edit cube

2017-09-03 Thread Li Yang
As a workaround, you can reload metadata (under System tab) and edit again. On Thu, Aug 31, 2017 at 3:22 PM, Cheng Wang wrote: > Sometimes it happens because one Kylin instance is used by multi-users. > Please make sure there are no others using the Kylin at the same time. > > > > > On 8/31/17,

Re: Document for Kylin with MicroStrategy

2017-09-03 Thread Li Yang
Cool~~~ On Fri, Sep 1, 2017 at 1:27 PM, ShaoFeng Shi wrote: > Hi, > > Joanna He (jingke...@kyligence.io) contributed a doc on how to integrate > Kylin with MicroStrategy. The doc has been published on Kylin website[1] > today. Thanks Joanna's contribution. > > https://kylin.apache.org/docs21/tut

Re: how to filter long tail data

2017-09-03 Thread Li Yang
Please ask Kylin related question here. On Fri, Sep 1, 2017 at 2:47 PM, 杨浩 wrote: > If a index is less than 2, we don't want to store it in hbase . How to > filter the long tail data ? >

Both Pull Request and patch are welcome

2017-09-09 Thread Li Yang
Just want to make it clear that both Pull Requests (PR) and patch files are welcome as the form of code contribution. And JIRA is required for both cases to track the task. I see the number of open PRs in github Kylin repo is growing. PR creator please double check you also create a JIRA and attac

Re: Question: The limit on the kylin web UI, what does it limit?

2017-09-10 Thread Li Yang
Seems a bug in limit handling. Could you open a JIRA to describe the problem? On Mon, Sep 4, 2017 at 1:43 PM, Mu Kong wrote: > Hi all, > > The previous email seems to be blocked. So I'm re-send this email. > I was running a group by query with subquery. Something like the follows: > > SELECT >

Re: when status of segment is 'NEW',the last_build_job_id is null

2017-09-10 Thread Li Yang
Both the GUI (jobs panel) and Rest API can find failed jobs. http://kylin.apache.org/docs21/howto/howto_use_restapi.html#get-job-list On Mon, Sep 4, 2017 at 6:30 PM, 周湘伦 wrote: > Thank you for your answer. > One more question: > how can i search for the failed job list? By command or API? > > >

Re: why can't I see the project which is created by other kylin server when I visit a kylin server ?

2017-09-10 Thread Li Yang
Any way to reproduce the encountered error? On Tue, Sep 5, 2017 at 2:52 PM, jun <1063489...@qq.com> wrote: > I have counter this problem also, but I have set kylin.rest.servers. > I found that meta can't synchronize between servers only after I load > metadata again. > Also when I delete cube, I

Re: Question: The limit on the kylin web UI, what does it limit?

2017-09-16 Thread Li Yang
nk you for your support! > > Best regards, > Mu > > On Sun, Sep 10, 2017 at 5:05 PM, Li Yang wrote: > > > Seems a bug in limit handling. Could you open a JIRA to describe the > > problem? > > > > On Mon, Sep 4, 2017 at 1:43 PM, Mu Kong wrote: > > >

Re: Kylin lost connection to zookeeper and keep on reconnect and fail in "Build Dimension Dictionary" step

2017-09-16 Thread Li Yang
There is not much context of the original problem. But from the title, if Kylin lost connection to zookeeper, it is likely a environment stability problem. On Sat, Sep 9, 2017 at 11:16 AM, ghost <2056763...@qq.com> wrote: > I met the same question,did you solve it? > > -- > Sent from: http://apac

Re: Kylin on Docker for production use

2017-09-16 Thread Li Yang
I recall a docker Kylin in early days, maybe around time of 1.3? Or early? But that was not maintain. Contribution is appreciated about docker. On Wed, Sep 13, 2017 at 5:38 PM, ShaoFeng Shi wrote: > Hi Arnault, > > Today most users are running directly on OS (an edge node of the Hadoop > cluste

Re: How to clean up the invisible cube

2017-09-17 Thread Li Yang
The cube should be there unless something wrong with your metadata. You may check kylin.log to see if any error during system start when cubes are loaded. On Thu, Sep 14, 2017 at 3:39 PM, apache_...@163.com wrote: > Hi: > > Sometime,When I delete a model, Prompt is referenced by cube, But I

Re: how long the kylin query cache valid?

2017-09-17 Thread Li Yang
The query cache is a LRU cache. There are two reasons an entry is removed from cache. 1. Many newer queries fill the cache, then the relative older query is removed. 2. When new cube build is completed, all query cache in the same project is removed. On Thu, Sep 14, 2017 at 4:47 PM, funky wrote

<    1   2   3   4   5   6   >