Re: Cubes get built in default namespace

2017-02-08 Thread Billy Liu
Here are some comments https://issues.apache.org/jira/browse/KYLIN-232 2017-02-09 9:23 GMT+08:00 Ajay Chitre : > We noticed that the Cubes are getting built in the 'default' namespace in > HBase. We're not allowed to use default namespace in production. Is there a > way

Re: How to deploy multiple standalone apache kylin in single machine properly

2017-02-24 Thread Billy Liu
If you just start one instance, could the sample cube build successfully? 2017-02-24 16:56 GMT+08:00 李智康 : > Hi, all > I have installed two standalone kylin on a sinlge machine, one version is > v1.5.3 and the other is v1.6. I modified parameters of > kylin.hdfs.working.dir

Re: Apache Kylin 2.0.0 beta is ready for download

2017-02-25 Thread Billy Liu
+1 Thanks Yang, nice work. 2017-02-25 20:41 GMT+08:00 Li Yang : > Dear all, > > Glad to let you know that the Apache Kylin 2.0.0 beta > is ready for download and test. This > is not an official release, but a beta build aims for preview and

Re: Kylin and BI Tools

2017-01-16 Thread Billy Liu
I have interest on Zeppelin also, please refer to http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/interpreter/kylin.html first. 2017-01-16 19:14 GMT+08:00 Alberto Ramón : > yes, > - I will fix "Carabel" to "Caravel". (It is a shame that this project is > not updated,

Re:

2017-01-17 Thread Billy Liu
; "LANGUAGEID", >>> 173, >>> 1 >>> ], >>> [ >>> "AFFILIATEID", >>> 36, >>> 1 >>> ], >>> [ >>> "ACCOUNTID", >>> 62, >>> 1 >>> ], >>>

Re: Cube tunning

2016-12-08 Thread Billy Liu
> in one group. Why is there exists multiple aggregation groups? I another > words, *we can define multi hierarchy dimensions in one group rather than > create multi group.* > > 2016-12-09 12:32 GMT+08:00 Billy Liu <billy...@apache.org>: > >> Suppose you have N

Re: Kylin stream cube timezone problem

2016-12-13 Thread Billy Liu
FYI: http://apache-kylin.74782.x6.nabble.com/JDBC-query-result-Date-column-get-wrong-value-td5370.html 2016-12-14 14:25 GMT+08:00 徐 鹏 : > Hi all: > When querying stream cube ,the timestamp use gmt. But I want GMT+8,what > should I do? > > Query time:2016-12-14 14:15

Re: kylin_sales_cube fails to build on first step

2016-12-13 Thread Billy Liu
Please check the sample.sh log first. You could run the script again. 2016-12-14 13:32 GMT+08:00 徐 鹏 : > can you see these table by hive client/beeline > > 在 2016年12月14日,下午1:26,John Ruiz 写道: > > Hello! > > I've run $KYLIN_HOME/bin/sample.sh and then

Re: Re: Cube Dup key found

2016-12-07 Thread Billy Liu
In your case, the order table would be fact table, and user table would be lookup table. Could you have a try? 2016-12-06 17:51 GMT+08:00 quzhengp...@hetrone.com : > Hi , > hive> desc uc_users; > OK > *user_id int* > *u**ser_modify

Re: Cube tunning

2016-12-08 Thread Billy Liu
Suppose you have N dimensions, and all in one agg group, then the total cuboid will be 2^N. But if you split N into N1, N2, N3, which N1+N2+N3>=N, then the total cuboid will be 2^N1+2^N2+2^N3. You will figure out how improvement this could be. How to split the agg groups depends on how your query

Re:

2017-01-12 Thread Billy Liu
I have concerns with so many segments. Please try query only one cube with one segment first. 2017-01-12 13:36 GMT+08:00 Phong Pham : > Hi, > Thank you so much for your help. I really appreciate it. Im really > impressed with your project and trying to apply it to our

Re: kylin.hbase.region.cut and Kylie.hbase.hfile.size.gb is not working in yarn

2017-01-03 Thread Billy Liu
Thanks Da Tong for the careful code check. But actually, both BatchCubingJobBuilder and BatchCubingJobBuilder2 will call HBaseMRSteps.createCreateHTableStep, The CreateHTableJob step will calculate the regions by split parameter. 2017-01-03 16:25 GMT+08:00 Da Tong : > Hi,

Re: [Announce] New Apache Kylin committer Kaisen Kang

2017-01-03 Thread Billy Liu
Congrats, welcome Kaisen. 2017-01-03 19:12 GMT+08:00 Luke Han : > On behalf of the Apache Kylin PMC, I am very pleased to announce > that Kaisen Kang has accepted the PMC's invitation to become a > committer on the project. > > We appreciate all of Kaisen's generous

Re: kylin.hbase.region.cut and Kylie.hbase.hfile.size.gb is not working in yarn

2017-01-03 Thread Billy Liu
The default region.cut is 5, and default hfile.size.gb is 2. What's your setting? 2017-01-03 19:33 GMT+08:00 Billy Liu <billy...@apache.org>: > Thanks Da Tong for the careful code check. > But actually, both BatchCubingJobBuilder and BatchCubingJobBuilder2

Re: Problem with query cache

2017-01-09 Thread Billy Liu
*Hit Exception Cache: false *means your query does not hit not cache, if you query again, the result would be "Hit Exception Cache: true" 2017-01-09 17:20 GMT+08:00 Phong Pham : > Hi, > i saw this on log file after a query finished: > > *Accept Partial: true* > *Is

Re: Kylin query performance always slows in first time

2017-01-06 Thread Billy Liu
If you repeat the same query again, it will hit the query cache I think. 2017-01-06 15:39 GMT+08:00 Hoang Le Trung : > Hi team, > > > > I have faced problem about query performance on Kylin. > > I run two instance Kylin(job) and Kylin(query) on two node of my hadoop >

Re: Kylin run mode query not update metadata

2016-12-23 Thread Billy Liu
kylin.rest.servers is used to define the server list of all your kylin nodes. In your case, it should be node1:7070,node2:7070(suppose the node name is node1 and node2) Kylin will call REST API against these server URL endpoints to update the metadata cache. 2016-12-23 16:08 GMT+08:00 Hoang Le

Re: questions for kylin

2016-12-26 Thread Billy Liu
For job server HA, please refer to https://issues.apache.org/jira/browse/KYLIN-2006. The routing or we often call it Ad-Hoc Query is an important feature for Kylin's future. But there is no deadline or restrict schedule. Kylin is open source project, and driven by community. If someone could

Re: ArrayIndexOutOfBoundsException: -1

2016-12-26 Thread Billy Liu
This is the known restrict for Kylin currently. But the good news is Kylin master has supported the same name column in both fact table and lookup table. The restriction will go away from the next release. Here is a workaround, rename the column by Hive view. 2016-12-26 18:28 GMT+08:00 Alberto

Re: Re: Drill integration ?

2017-03-17 Thread Billy Liu
tical > queries) with more coverage (drill).(e.g. cases of no realization found > or cross cube join)... > > On Thu, Mar 16, 2017 at 12:20 PM, Billy Liu <billy...@apache.org> wrote: > >> Hi Heer, >> >> May I ask more more for this proposal, the benefits

Re: Drill integration ?

2017-03-16 Thread Billy Liu
Hi Heer, May I ask more more for this proposal, the benefits or use case? 2017-03-16 7:58 GMT-07:00 Sonny Heer : > Is there any support for Apache Drill within Kylin? Any tickets for work > done around this yet? > > Thanks > >

Re: Hive table design (multiple fact tables or rolled up)

2017-03-15 Thread Billy Liu
Kylin is the OLAP on Hadoop. OLAP is the read-only query engine. So we suppose there is no update/delete operator directly. Kylin support build incrementally. So if new data is ingested, you could build new one(new time range). If you want to update existing cube since the underline data changed,

Re: Hive table design (multiple fact tables or rolled up)

2017-03-08 Thread Billy Liu
please check star schema first: https://en.wikipedia.org/wiki/Star_schema 2017-03-08 12:48 GMT-08:00 Sonny Heer : > Hi I'm somewhat new to Kylin. we have a relational db schema imported > into hive as is at the moment. The schema is highly normalized with lots > of tables.

Re: Get the login User in class HiveCmdBuilder

2017-03-01 Thread Billy Liu
You are welcomed to contribute this feature if ready. Currently, Kylin does not support it yet. 2017-03-01 17:52 GMT+08:00 java_prog...@aliyun.com : > Hi, > I config Kylin using ldap successful, the ldap service is the same as > the one which is used by hive. > I

Re: error when load table from kafka

2017-08-11 Thread Billy Liu
Could you describe the Kylin version and reproduce steps, and kylin.log? 2017-08-09 20:42 GMT+08:00 崔苗 : > Hi, > there is an error when load table from kafka: > Overwriting conflict /table/DEFAULT.USERLOGIN.json, expect old TS 0, but > it is 1502279074583 > > Thanks >

Re: error execute org.apache.kylin.storage. hbase.util.StorageCleanupJob

2017-07-24 Thread Billy Liu
I think the issue has been fixed in latest master code. Could you pull the code and have a try? 2017-07-24 18:24 GMT+08:00 liulang : > hi, > Run StorageCleanupJob error: > > 2017-07-24 16:04:28,645 INFO [main StorageCleanupJob:283]: Checking table > SLF4J: Class path

Re: Kylin window function

2017-07-24 Thread Billy Liu
+ Yerui. Do you have any idea? 2017-07-25 11:25 GMT+08:00 Joanna He (Jingke He) : > The tech blog I referred. > > http://kylin.apache.org/blog/2016/11/16/window-function/ > > > > > > 何京珂 > > Joanna He > > > > > > *From: *"Joanna He (Jingke He)" >

Re: StorageCleanup error

2017-07-04 Thread Billy Liu
What's the new log? Did you call kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true? 2017-07-04 15:48 GMT+08:00 ZhangXuan : > I build new version and test it ,but the error still exist, so I use 1.6 > to clean up first, and next run in 2.0.0, error disappeared. >

Re: Usage of aggregation groups

2017-07-04 Thread Billy Liu
Hi Sony, Here is one article introducing aggregation group: https://kyligence.gitbooks.io/kap-manual/content/en/model/cube/aggregation_group.en.html 2017-07-04 10:43 GMT+08:00 Sonny Heer : > Can you describe the relationship between when using a dimension in the > WHERE

Re: A problem about building cube in java

2017-07-05 Thread Billy Liu
The error message is not clear enough, you'd better show full log to let others reproduce your issue. 2017-07-05 14:57 GMT+08:00 孙雁鸣 : > > Hi all: > My system is ubuntu. When I built kylin cube in java, it return the > following message. How can I do? Thanks. > >

Re: 关于麒麟对kafka实时数据分析的支持

2017-04-24 Thread Billy Liu
Kylin use Kafka consumer API to retrieve the data and save the offset into metadata when the cube is built successfully. There will no data lost. If the build failed, you could re-trigger the build again. The data(streaming cube) available latency quite depends on your cluster capability. In some

Re: Issues with Kylin 1.6 and Tableau 10

2017-04-24 Thread Billy Liu
Kylin crashes since Tableau issues the "select * from fact_table", that query will load all fact records and exhaust all memory resource. Have you checked the "Live" connection on the Tableau? In “Live" mode, Tableau should not send out that query. 2017-04-24 3:52 GMT+08:00 Roberto Tardío Olmos

Re: [Announce] New Apache Kylin committer Roger Shi

2017-04-29 Thread Billy Liu
Welcome Roger. 2017-04-29 22:19 GMT+08:00 ShaoFeng Shi : > Welcome Roger! > > 2017-04-29 19:46 GMT+08:00 Dong Li : > >> Welcome! >> >> >> Thanks, >> Dong Li >> >> >> Original Message >> Sender:Li yangliy...@apache.org >>

Re: [Announce] New Apache Kylin committer Zhixiong Chen

2017-04-29 Thread Billy Liu
Welcome Zhixiong! 2017-04-29 22:19 GMT+08:00 ShaoFeng Shi : > Welcome Zhixiong! > > 2017-04-29 20:04 GMT+08:00 Alberto Ramón : > >> Congratulations to Roger Shi and Zhixiong!! (and Dev team for next 2.0 >> version) >> >> If you are ever near

Re: No result from JDBC with Date filter in prepareStatement

2017-08-20 Thread Billy Liu
THank you for reporting. Could you check the kylin.log first? 2017-08-21 11:15 GMT+08:00 程 万胜 : > > 大家好: > > 用kylin的JDBC查询,查询条件是date类型的,如果通过prepareStatement、setDate是查询不出数据 > 的,然而直接用SQL可以查出数据 > > 我用的是kylin版本:apache-kylin-1.6.0-cdh5.7-bin,jdbc版本:kylin-jdbc-1.6.0.jar >

Re: Kylin query return empty after upgrade to 2.0

2017-08-22 Thread Billy Liu
Query by REST API? or JDBC? 2017-08-22 12:24 GMT+08:00 yu feng : > Hi, After I upgrade our env. from 1.5.2.1 to 2.0.0, building things go > well, However, every query to older(generated before upgrading) return > empty(0 result), and newly build segment return result

Re: Not able to edit cube from UI

2017-05-11 Thread Billy Liu
If the cube has ready segments, the edit is not available. 2017-05-12 9:17 GMT+08:00 Nirav Patel : > Looks like I had to 'Disable' cube first in order to edit it. So this > means no queries would be served from this cube while I am modifying it. > > On Thu, May 11, 2017 at

Re: Not able to edit cube from UI

2017-05-11 Thread Billy Liu
"Ready segment" means the segment is built successfully. 2017-05-12 13:06 GMT+08:00 Nirav Patel <npa...@xactlycorp.com>: > What do you mean by "ready segments"? Cube that went through Build process? > > On Thu, May 11, 2017 at 7:21 PM, Billy Liu <billy...@a

Re: A problem in cube moving

2017-05-11 Thread Billy Liu
Copy from Shaofeng‘s reply "Hi, To migrate/move a cube from staging Kylin to production Kylin, you can use the tool CubeMigrationCLI, e.g, on v2.0, run : $KYLIN_HOME/bin/kylin.sh org.apache.kylin.tool.CubeMigrationCLI it will print out the usage info. Follow the instruction to go ahead. (in

Re: Does Kylin 2.1.0 supports streaming_cubes feature ?

2017-05-15 Thread Billy Liu
http://kylin.apache.org/blog/2016/10/18/new-nrt-streaming/ 2017-05-15 16:55 GMT+08:00 Sree Eedupuganti : > Hi > > -- > Best Regards, > Sreeharsha Eedupuganti > Data Engineer > innData Analytics Private Limited >

Re: Streaming cube - workaround to duplicate messages by kafka producer retry?

2017-05-16 Thread Billy Liu
Kafka provides the ack mechanism, although all ack solution would hurt the throughput and performance. User could configure it by kafka client parameter. Kylin would not know and should not know how to process the duplicate messages. The duplicate is semantic concept. What Kylin could guarantee is

Re: Questions about SUM behavior when rewritten as TOPN

2017-05-13 Thread Billy Liu
Thanks Tingmao for the report. Could you show us the complete SQL? In your SQL, there is no order by statement. If no ORDER BY, the query should not be rewritten into TopN measure. 2017-05-12 23:52 GMT+08:00 Tingmao Lin : > Hi, > > We found that SUM() query on a cardinality 1

Re: Can Kylin execute sql and fetch result in command line?

2017-06-20 Thread Billy Liu
e.org> > *Date: *Tuesday, 20 June 2017 at 1:14 PM > *To: *"user@kylin.apache.org" <user@kylin.apache.org> > *Subject: *Re: Can Kylin execute sql and fetch result in command line? > > > > Thanks. I will try it. > > > > *From: *Billy Liu <billy.

Re: Microstratergy Integration with Kylin

2017-06-26 Thread Billy Liu
Hi Saurabh, Here is an article I could share with you how MSTR could connect with Kylin: https://kyligence.gitbooks.io/kap-manual/content/en/integration/microstrategy_10_4.en.html 2017-06-26 22:28 GMT+08:00 ShaoFeng Shi : > Microstrategy 10.x can connect with Kylin via

Re: 答复: A problem in cube migration

2017-05-22 Thread Billy Liu
Thanks for updating. 2017-05-22 16:03 GMT+08:00 吕卓然 <lvzhuo...@fosun.com>: > Hi Billy, > > > > I already solved it. This is because of my Hadoop Env. > > > > Thanks, > > Zhuoran > > > > *发件人:* Billy Liu [mailto:billy...@apache.org]

Re: A problem in cube migration

2017-05-21 Thread Billy Liu
Hi Zhuoran, Are you still blocked by this issue? I tried to reproduce it, but failed. 2017-05-19 16:16 GMT+08:00 吕卓然 : > Hi all, > > > > Currently I am using Kylin2.0.0 with CDH 5.8. I’m trying to migrate cubes > from one kylin server to another. Below is my command to

Re: query with timestamp error?

2017-05-18 Thread Billy Liu
Your description is not clear enough. What's the cube desc json? What's the exception message? What's the sample data structure and column data? 2017-05-18 11:41 GMT+08:00 446463...@qq.com <446463...@qq.com>: > Hi: > I build a cube and use timestamp(-MM-dd) with a dimension in mine cube > .

Re: table_snapshot file does not exist

2017-05-18 Thread Billy Liu
Is it a build error? or query error? You mentioned two scenarios, but one exception. 2017-05-18 14:25 GMT+08:00 jianhui.yi : > Hi all: > >When I build cube to run step 4: Build Dimension Dictionary, the > following error occurred,how to solve it? > > When I use

Re: Cannot install Kylin on CDH 5.11 CentOS 7

2017-05-23 Thread Billy Liu
There should be more exceptions which is the root cause. Please check again. 2017-05-23 15:36 GMT+08:00 Szalai Gergely : > Hi all, > > > > I succesfully installed Kylin but the UI won’t start. > > > > Could you please advice? > > > > Context initialization failed2017-05-23

Re: kylin 2.0 ODBC Driver

2017-05-23 Thread Billy Liu
Yes. There is little changes in ODBC since last release. 2017-05-23 14:43 GMT+08:00 仇同心 : > Hi,all > > After upgraded to kylin 2.0, if the ODBC access, the version of ODBC > Driver is still use Kylin ODBC Driver v1.6 ? > > > > Thanks~ >

Re: How to clean up after Kylin 2.0

2017-05-16 Thread Billy Liu
Thanks Itay for raising this question. When you rebuild the cube, the old segment will be invalid for query, but available for cleanup. The StorageCleanupJob should clean those files, but if not, that may be an issue. Could you log a JIRA for this issue and describe how to reproduce it? That will

Re: kylin merge segments giving "not upported sql error"

2017-06-11 Thread Billy Liu
ann...@trinitymobility.com>: > The lookup tables are using insert mode only. I am able to use all lookup > tables ,but fact table only have the problem. > > > > *From:* Billy Liu [mailto:billy...@apache.org] > *Sent:* Tuesday, June 06, 2017 6:46 AM > *To:* user > *Subject:* Re: kylin me

Re: Fwd: Re: kylin in VM Cloudera 5.10

2017-06-15 Thread Billy Liu
Please check kylin.log and YARN job log for further information. If something wrong, you could find the clue from the log. 2017-06-16 11:07 GMT+08:00 Patricio Eduardo Huichulef Carvajal < patricio.edua...@huichulef.com>: > Dear All: > > Can you help me with tihs problem please? > I have

Re: kylin merge segments giving "not upported sql error"

2017-06-05 Thread Billy Liu
More related logs will help identify the root cause. By the way, when merging the segment, you should keep the lookup table insert/update only. If some primary keys in lookup table are deleted, when you query the old segments, the primary key in lookup table will be invalid. 2017-06-05 14:01

Re: use standalone secure Hive and MR

2017-06-27 Thread Billy Liu
Are you looking for this http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/? 2017-06-27 20:07 GMT+08:00 杨浩 : > Our company have used a hadoop version different from Apache Hadoop, and > kerberos is used to keep secure. Our group want to use Kylin, using hive

Re: How to merge cube segments with holes?

2017-10-08 Thread Billy Liu
geEmptySegment\"])\n at [Source: > org.apache.catalina.connector.CoyoteInputStream@61b3d534; line: 1, > column: 87] (through reference chain: org.apache.kylin.rest.request. > JobBuildRequest[\"isForce\"])"} > > > > > > I tried with force=true parameter also, its g

Re: How to merge cube segments with holes?

2017-10-03 Thread Billy Liu
10255ad; line: 1, column: > 15]; nested exception is com.fasterxml.jackson.core.JsonParseException: > Unexpected character (',' (code 44)): expected a valid value (number, > String, array, object, 'true', 'false' or 'null')\n at [Source: > org.apache.catalina.connector.CoyoteInputStream@10255ad;

Re: How to merge cube segments with holes?

2017-10-10 Thread Billy Liu
in/api/cubes/trinityAnalyticsCube/rebuild > > > > *EXCEPTION:* > > > > {"url":"http://ipaddress:7070/kylin/api/cubes/AnalyticsCube/rebuild","exception":"Merging > segments must not have holes between > AnalyticsCube[2017070100_

Re: How to merge cube segments with holes?

2017-10-10 Thread Billy Liu
Another workaround is to trigger PUT kylin/api/cubes/AnalyticsCube/holes to fill up the holes. 2017-10-10 18:01 GMT+08:00 Billy Liu <billy...@apache.org>: > The code is a little old. Could you have a try on the latest 2.1? > > 2017-10-09 15:41 GMT+08:00 <prasann...@t

Re: 关于kylin设置queuename遇到的问题

2017-10-16 Thread Billy Liu
Seems like a bug, could you open a JIRA for this? 在 2017年10月16日 下午5:47,wanglb 写道: > 最近在cdh5.7搭建kylin2.1环境后,构建cube时遇到问题 > > 需要修改队列名称 > 在kylin.properties文件配置队列参数如下: > kylin.source.kylin.client=beeline > kylin.engine.mr.config-override.mapreduce.job.queuename = root.cbasQueue >

Re: Persistent error after Kafka streaming cube source stopped

2017-10-16 Thread Billy Liu
Hi Roberto, Could you update more logs. It should has more logs from the context. 2017-10-16 17:19 GMT+08:00 Roberto Tardío : > Hi, > > I'm doing a PoC with to build a cube with Kylin using a Streaming Data > with Kafka. Kafka connection and cube creation works

Re: query return error result.

2017-10-11 Thread Billy Liu
Nice found. +1 2017-10-11 15:08 GMT+08:00 yu feng : > I checked the code, and find root cause is DumpMerger.enqueueFromDump() > > I create a jira KYLIN-2926 > to trace the bug. > > > > 2017-10-09 10:37 GMT+08:00 yu feng

Re: Merge Segment ERROR

2017-10-12 Thread Billy Liu
Fixed at https://issues.apache.org/jira/browse/KYLIN-2794, and will be released in Apache Kylin 2.2 2017-10-11 15:41 GMT+08:00 s丶影中人* <845286...@qq.com>: > When i merge the segment encounter error, how can i solve it. Please... > Log as follows: > > 2017-10-11 15:24:56,139 ERROR

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
ssl.secure.random.implementation = null > > ssl.trustmanager.algorithm = PKIX > > ssl.truststore.location = null > > ssl.truststore.password = null > > ssl.truststore.type = JKS > > value.deserializer = class org.apache.kafka.common.serialization. > StringDese

Re: cannot file ojdbc6.jar while kylin startup

2017-10-12 Thread Billy Liu
You could ignore the boring message. That's tomcat tries to detect ODBC libraries from environment. Not real Kylin error. 2017-10-12 17:19 GMT+08:00 li...@fcyun.com : > > Hi, all > > Here my logs in kylin.out file. why this error ocuurs? > > > Another confusion, while I start

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
Hi Kumar, Could you paste more Kafka Consumer related log in kylin.log? And also check from the Kafka broker side, if the Kylin client has connected to Broker. 2017-10-12 14:29 GMT+08:00 Kumar, Manoj H : > Building the Cube from Kylin UI - Although Messages are there

Re: Kafka Streaming data - Error while building the Cube

2017-10-13 Thread Billy Liu
And in Kylin tutorial, the topic is kylindemo, in your sample, the topic is kylin_demo. Please double check the topic name. 2017-10-13 14:27 GMT+08:00 Billy Liu <billy...@apache.org>: > If you could package the source code, please try to add more debug log > when retrieving pa

Re: different mr config for different project or cube

2017-09-05 Thread Billy Liu
You could override the default MR config on the project level or cube level through the GUI, not the file. 2017-09-06 10:11 GMT+08:00 yu feng : > I remember Kylin support use different mr config file for different > project, like KYLIN-1706 >

Re: Query across different MODEL/CUBES

2017-09-06 Thread Billy Liu
It sounds like a HINT in SQL. 2017-09-06 17:51 GMT+08:00 Yuxiang Mai : > Hi,all > > We have some questions about query across different model/cubes. We know > that kylin will evaluate the cost and select the best cube to query. In > our usage, this worked very good. But

Re: Kylin and SuperSet

2017-09-12 Thread Billy Liu
Kylin is driven by the community. If some proposal or patch working on this task, the new feature will be ready soon. The community will be excited if we have this integration, but no actual effort yet. I saw some prototypes on the integration between Apache Kylin and SuperSet on some customer's

Re: How to merge cube segments with holes?

2017-10-03 Thread Billy Liu
The merge API has one parameter named isForce in JobBuildRequest. Could you set it to true and try again? 2017-10-03 20:25 GMT+08:30 : > Hi all, > > > > Anybody have any idea about how to merge cube segments with hole. if I > tried to merge its giving as, > > > >

Re: Segment overlap when merge

2017-09-27 Thread Billy Liu
The metadata has the wrong segments already. If you dump out the metadata, should figure out one of that segments is invalid. Remove that segment and restore the metadata. 2017-09-28 11:59 GMT+08:00 luoyong...@yaochufa.com : > > Hi: > kylin causes an

Re: Re: Segment overlap when merge

2017-09-28 Thread Billy Liu
> "DEFAULT.KYLIN_CATEGORY_GROUPINGS" : "/table_snapshot/ > DEFAULT.KYLIN_CATEGORY_GROUPINGS/b3875fd4-44a5-4100- > bf08-7d54e307cf8b.snapshot" > }, > "rowkey_stats" : [ [ "LEAF_CATEG_ID", 134, 1 ], [ " > META_CATEG_NAME&quo

Re: 答复: No result from JDBC with Date filter in prepareStatement

2017-08-21 Thread Billy Liu
here part_dt <= ? group by part_dt order by > part_dt limit 100 > User: ADMIN > Success: true > Duration: 0.067 > Project: learn_kylin > Realization Names: [CUBE[name=kylin_sales_cube]] > Cuboid Ids: [16384] > Total scan count: 0 > Total scan bytes: 0 > Result row c

Re: 答复: 答复: No result from JDBC with Date filter in prepareStatement

2017-08-22 Thread Billy Liu
RY]=== > Query Id: cc783405-8d75-4f3c-9fdb-411427111448 > SQL: select * from KYLIN_SALES where part_dt = ? > User: ADMIN > Success: true > Duration: 0.011 > Project: learn_kylin > Realization Names: [] > Cuboid Ids: [] > Total scan count: 0 >

Re: count_distinct_if, count_if and sum_if

2017-08-28 Thread Billy Liu
This kinds of contribution is very welcomed. Could you send your issue to dev mailer, the community will help you. 2017-08-28 21:40 GMT+08:00 Alexander Sterligov : > Hi! > > It would be nice to have if-functions in kylin. What do you think? > > I've already implemented

Re: where OPS_REGION=lower('Shanghai') ERROR

2017-08-23 Thread Billy Liu
What happened if no LOWER function used? 2017-08-21 11:05 GMT+08:00 程 万胜 : > hello all: > > > error log: > > > 2017-08-21 10:26:32,624 INFO [Query 4bb70ccb-68e7-4b11-965f-e3d8e8bfd5d9-82] > service.QueryService:366 : Using project: learn_kylin > 2017-08-21 10:26:32,625

Re: Can KYLIN support select if ... from SQL?

2017-09-01 Thread Billy Liu
Mai <yuxiang@gmail.com>: > Thanks.. > > We will try it. > > BTW, any drawbacks if we directly use in a where condition? > > > > On Fri, Sep 1, 2017 at 11:37 PM, Billy Liu <billy...@apache.org> wrote: > >> The suggested way is to define new column

Re: 答复: where OPS_REGION=lower('Shanghai') ERROR

2017-08-31 Thread Billy Liu
Could you file a JIRA to track this issue? 2017-08-24 11:44 GMT+08:00 程 万胜 <chivise...@hotmail.com>: > it's fine if no LOWER function used! > > -- > *发件人:* Billy Liu <billy...@apache.org> > *发送时间:* 2017年8月24日 10:44 > *收件人:* user >

Re: apache-kylin-2.1.0-bin-cdh57.tar.gz

2017-10-09 Thread Billy Liu
The CDH57 works for all CDH 5.7+ 2017-10-10 2:35 GMT+08:00 Ruslan Dautkhanov : > From the Downloads page I can only see apache-kylin-2.1.0-bin-cdh*57*. > tar.gz > Are there more current builds .. like for CDH 5.*12*? > If not, does it make sense to build Kylin myself? (not

Re: [外部邮件] Re: [外部邮件] 回复:kylin drop cube segment Htable 仍然存在

2017-10-18 Thread Billy Liu
Agree. A new patch is needed in KYLIN-2846. It's not a bug still, but an unfinished improvement I think. Let's continue to improve this issue. 2017-10-18 21:05 GMT+08:00 ShaoFeng Shi : > Hi Yaowu, > > Could you please update this patch in KYLIN-2846? Storage cleanup

Re: Export and Import metadata between Kylin clusters

2017-10-23 Thread Billy Liu
Hi Shaofeng, Do you think the CubeMetaExtractor and CubeMetaIngestor could do the this job? 2017-10-23 22:51 GMT+08:00 ShaoFeng Shi : > BTW, would you like to report a JIRA for this? thanks. > > 2017-10-23 22:51 GMT+08:00 ShaoFeng Shi : > >> I

Re: Set up Development environment at intelliji

2017-11-12 Thread Billy Liu
Hi Kumar, Coudl you check out this doc first http://kylin.apache.org/development/dev_env.html ? 2017-11-12 23:45 GMT+08:00 Kumar, Manoj H : > Can you pls. give step by step to do Dev. Set up of Apache Kylin? Since I > am not from Java Background, Pls. give the

Re: [Discuss] Disable/hide "RAW" measure in Kylin web GUI

2017-11-28 Thread Billy Liu
ink it is time to disable the RAW measure on Kylin now. JIRA >> created for it: https://issues.apache.org/jira/browse/KYLIN-3062 >> >> Please comment if you see any issue. >> >> 2016-12-19 22:03 GMT+08:00 Billy Liu <billy...@apache.org>: >> >> > The ex

Re: Build cube and streaming cube problems

2017-11-24 Thread Billy Liu
I suggest you seperating different questions into sepearted mail thread. That makes the dicussion more focus. Kylin is designed of OLAP queries which is aggreated query, not for RAW data. Although it has a workaround solution for RAW measure. I am not sure if it works for dozen columns. Maybe you

Re: Strange HBase rpc operation timeout error

2017-12-15 Thread Billy Liu
Check this: http://apache-kylin.74782.x6.nabble.com/hbase-configed-with-fixed-value-td9241.html 2017-12-15 18:03 GMT+08:00 jxs : > Hi, > > Finally, I found this in org.apache.kylin.storage. > hbase.HBaseResourceStore: > > ``` > private StorageURL buildMetadataUrl(KylinConfig

Re: Re: Re: How to config kylin to use kerberized hadoop cluster

2017-12-17 Thread Billy Liu
kerberized version of its own? > > > > > At 2017-12-18 14:23:29, "Billy Liu" <billy...@apache.org> wrote: > > kylin.job.status.with.kerberos=true has been deprecated since > https://issues.apache.org/jira/browse/KYLIN-1319, and code removed recently. > > p

Re: Kylin Hue Integration Blog

2017-12-14 Thread Billy Liu
Very useful. Thanks, Joanna. I will we could repost it on the Kylin website also. 2017-12-14 18:04 GMT+08:00 JHe : > we have recently explored integrating kylin with Hue and have contributed > a blog to hue community. > > In this blog, we explained how you can integrate kylin

Re: kylin1.6 集群有些时候创建cube不能同步到其他节点上

2017-12-14 Thread Billy Liu
Hello Chenping, Quite a few metadata sync related issues are resolved recently, including: https://issues.apache.org/jira/browse/KYLIN-2834 https://issues.apache.org/jira/browse/KYLIN-2858 https://issues.apache.org/jira/browse/KYLIN-2834 You are strongly suggested to upgrade to the latest Kylin

Re: Re: Strange HBase rpc operation timeout error

2017-12-17 Thread Billy Liu
eady response time (in a range not two bad, eg: within 1 > minute) is somehow acceptable. > The previous timeout error just interrupted the cube building procedure, > we don't wan't that. > What is your suggestion for this use case? > > > > 在2017年12月16 11时48分, "Billy Liu&

Re: how to change the order of rowkey_columns

2017-11-14 Thread Billy Liu
You could change the rowkey order by drag-and-drop from GUI directly. 2017-11-14 10:52 GMT+08:00 杨浩 : >To speed up the query, we should position the frequent column before > others, such as partition column date should be at the first for every > query would contain it.

Re: Can hierarchyDims contain jointDims

2017-11-20 Thread Billy Liu
Hi Doom, Thank you for reading the code so carefullly. You are welcomed to contribute on this JIRA. 2017-11-19 16:42 GMT+08:00 doom <43535...@qq.com>: > So this issues is work in progress, and result in the two piece contradict > code. thank you for make me clear. > > > -- 原始邮件

Re: 如何在本地Windows环境下搭建kylin本地运行环境

2017-11-16 Thread Billy Liu
Hello, If you follow the doc, but meet some problems, please describe your steps and results(better with snapshot) in the mail. Then others will know where you are, and if in the wrong way. 在 2017年11月17日 上午10:35,Hey <1428117...@qq.com>写道: > 按照kylin官网来是可以的 ,需要nodejs下载kylin

Re: Kylin 2.1.0 new features than old versions.

2017-11-09 Thread Billy Liu
I will suggest waiting a few days. I know the bug has been fixed recently. But the code has not merged into master yet. 2017-11-09 14:29 GMT+08:00 Prasanna : > Hi all, > > > > Present I am using kylin 1.6.0 . If anybody is using kylin latest version > 2.X ,can

Re: About degenerate dimensions on Kylin cubes

2017-11-09 Thread Billy Liu
Hi Roberto, Degenerate dimensions on fact table is not supported I think. There is only two types dimensions: "normal" and "derived". All "normla" dimensions will be precaculated into cube. So it affects the construction cost and query latency. If some column in fact table do not need to be

Re: How to drop the segments

2017-11-08 Thread Billy Liu
http://kylin.apache.org/docs21/howto/howto_use_restapi.html Delete Segment DELETE /kylin/api/cubes/{cubeName}/segs/{segmentName} 2017-11-09 14:56 GMT+08:00 Kumar, Manoj H : > Can you pls. tell how to drop the Cube segment from backend? While > re-running the Cube

Re: Re: kylin2.1 can't work with hdp2.6.0

2017-11-02 Thread Billy Liu
> > *发件人:*ShaoFeng Shi <shaofeng...@apache.org> > *发送时间:*2017-10-31 16:07 > *主题:*Re: kylin2.1 can't work with hdp2.6.0 > *收件人:*"user"<user@kylin.apache.org> > *抄送:* > > Since 2.1, Kylin consolidates the metadata into one HBase

Re: Export and Import metadata between Kylin clusters

2017-11-02 Thread Billy Liu
this unresolved JIRA. KYLIN-1605 > <https://issues.apache.org/jira/browse/KYLIN-1605> > > I mean the posibility of migrate metadata from source, data model, cube > definition or all project in order to re build the all cube, e.g. with > different Hadoop cluster. > > Thank

Re: A problem about retention rate analyze

2017-12-07 Thread Billy Liu
This is not by design, could you show more exception logs? 2017-12-07 16:22 GMT+08:00 skyyws : > Hi guys, > I found that kylin supported retention rate analyze function, so I made > some test for this function. The following SQL executed successful: >

Re: kylin service is getting down frequently!

2017-12-05 Thread Billy Liu
Hi Prasana, What kinds of queries you were using? If you issued some "select *" to very huge table, it may cause OOM. Kylin is designed to answer OLAP-style queries very fast, but not detailed query. Could you check again? 2017-12-04 21:12 GMT+08:00 Ge Silas : > Hello, > > Can

  1   2   >