Re: [DISCUSS] Upgrade Kylin's dependency to Hadoop 3 / HBase 2

2020-03-02 Thread Billy Liu
+1. Let's move to Hadoop3 With Warm regards Billy Liu ShaoFeng Shi 于2020年2月27日周四 下午10:07写道: > Hi Yang, > > The main difference between 2.6 and 3.0 is the new real-time OLAP feature. > Hadoop 2 users can select either of them, depends on whether they need the > real-time fea

Re: Dimension data often changes, and the historical dimensions data need to be queried. What is the recommended solution?

2019-12-25 Thread Billy Liu
build the historical value into segment directly. With Warm regards Billy Liu bo.hao 于2019年12月25日周三 下午2:19写道: > sorry, picture of the first mail may not be displayed... here is an > explanation: > > before merging: > All fields have results. > > after merging: > Data o

Re: [DISCUSS] Upgrade Hadoop-related dependencies’ to Hadoop3 for master branch

2019-10-01 Thread Billy Liu
+1. Kylin 3 aligns with Hadoop 3 With Warm regards Billy Liu Luke Han 于2019年10月1日周二 下午1:24写道: > > +1, we should move on to next-g Hadoop > > Best Regards! > - > > Luke Han > > > On Mon, Sep 30, 2019 at 12:39 AM nichunen wrote: >> >&

Re: 事实表历史数据的更新,如何更新cube

2019-09-03 Thread Billy Liu
数据回填(write-back)目前是不支持的,也不在计划上。 做到更高效的历史数据更新,就是要尽量不重刷无变化的数据,而变化的数据总要重新刷新。Kylin刷新的单位是Segment。如果不需要“支付”“开票”“创建”之间的关联计算,可以把这些字段拆在不同的Cube中,分别做Partition字段,刷新的时候要重刷新旧两个时间段。但这个可能的潜在风险是不同Cube之间,数据的不一致。 一般来说,数据的更新具备冷热属性,即热数据经常更新,冷数据不更新,因此可以针对冷热,设计不同规模的Segment,减少刷新时的复杂度。 With Warm regards Billy Liu

Re: Welcome to use docker for kylin

2019-08-28 Thread Billy Liu
Sounds cool With Warm regards Billy Liu Xiaoxiang Yu 于2019年8月28日周三 下午6:11写道: > > Great! I think it is the best way for user to learn Kylin if he/she do not > have a Hadoop env by just one command: > > > > docker run -d \ > > -m 8G \ > > -p 7070:7070 \ >

Re: QUESTION

2019-07-15 Thread Billy Liu
There must be something wrong during your loading. Kylin does not import real data from Hive, but import meta data only during the loading. Please check the log first. With Warm regards Billy Liu wangweilin 于2019年7月14日周日 下午7:28写道: > I transferred more than 200 G of data to hive,and then w

Re: Kylin on parquet

2019-06-28 Thread Billy Liu
The feature is still on-going, but I don't think it's a part of 3.0. Kylin 3.0 alpha has been released, most features are finalized for this major version. With Warm regards Billy Liu David Kis 于2019年6月28日周五 下午11:57写道: > > Hi, > > There was a discussion earlier that Kylin will be

Re: ask about kylin 3.0 Go-Live Date

2019-06-11 Thread Billy Liu
Before going live, more feedback is expected from beta users. There is no confirmed data for this major release. If you meet some issues or want to share some experience on the realtime Kylin, please update it with the community. With Warm regards Billy Liu Bryan Liu (CN) 于2019年6月11日周二 上午10:57

Re: 请问kylin当前支持的hive spark hbase的版本是什么

2019-06-02 Thread Billy Liu
Please check http://kylin.apache.org/docs/install/index.html I think most components you are using are quite new, and not fully verified by community user. You have to figure out the compitable issue carefully. With Warm regards Billy Liu aohanhe 于2019年6月2日周日 下午5:54写道: > > 各位大神,请问kyli

Re: Re: jdbc query with limit not work

2019-05-27 Thread Billy Liu
What's the result when you were running in the Kylin Insight page? How did you set the limit parameter by using JDBC? With Warm regards Billy Liu lk_hadoop 于2019年5月28日周二 上午9:33写道: > > what I want is the limit clause should be pushed down to hbase. > >

Re:

2019-04-14 Thread Billy Liu
n directly, as there is table model only in Power BI. I got a video demo link on YouTube, introducing other vendor solution for Kylin and Power BI, check this: https://www.youtube.com/watch?v=KynF6fds0aM With Warm regards Billy Liu Khalil Mejdi 于2019年4月13日周六 下午6:38写道: > > Greetings > > Hello

Re: Upgrade from 2.4.1 to 2.6.1

2019-03-19 Thread Billy Liu
Good to know. As you mentioned, the querying jost list has reduced the time from 10 seconds to 1, the improvement is not only from MySQL backend database, but also the querying job function itself. There are some enhancements about loading huge metadata. With Warm regards Billy Liu Iñigo

Re: [Discuss] Won't ship Spark binary in Kylin binary anymore

2019-03-07 Thread Billy Liu
+1 With Warm regards Billy Liu Zhong, Yanghong 于2019年3月8日周五 上午11:27写道: > Agree to exclude spark binary. > > > > -- > > Best regards, > > Yanghong Zhong > > > > *From: *yuzhang > *Reply-To: *"d...@kylin.apache.org" > *Date: *Friday, M

Re: Safe deletion of $KYLIN_HOME/tomcat/temp stuff

2019-01-25 Thread Billy Liu
Hi Xiaoxiang, I think you could put these operation info into Kylin FAQ, quite helpful. With Warm regards Billy Liu ShaoFeng Shi 于2019年1月21日周一 下午10:22写道: > Thanks for Xiao Xiang's information, it's quite clear. > > Best regards, > > Shaofeng Shi 史少锋 > Apache Kylin PMC >

Re: [Announce] Welcome new Apache Kylin committer: ChunEn Ni (倪春恩)

2018-11-27 Thread Billy Liu
Congrats, ChunEn. With Warm regards Billy Liu ShaoFeng Shi 于2018年11月27日周二 下午3:59写道: > > The Project Management Committee (PMC) for Apache Kylin > has invited ChunEn Ni(倪春恩) to become a committer and we are pleased > to announce that he has accepted. > > Congratulations a

Re: 【2.5.1] NoSuchMethodError: com.facebook.fb303.FacebookService

2018-11-13 Thread Billy Liu
Most of these issues are caused by wrong classpath. Try google some keyword. Point to the right environment variable path will solve your problem. With Warm regards Billy Liu Pengfei Guo 于2018年11月14日周三 下午2:32写道: > > hi,all: > > when I build cube,I ge

Re: kylin.log Deleted, how to restore

2018-10-22 Thread Billy Liu
It seems the file handler pointing to kylin.log could not be released. Please check if there is any kylin process is still there, and try to kill it and restart. With Warm regards Billy Liu 安卫华 <158989...@qq.com> 于2018年10月23日周二 上午10:12写道: > > Thank you very much sh

Re: [Announce] Welcome new Apache Kylin committer :Allen Ma

2018-10-16 Thread Billy Liu
Welcome Allen. With Warm regards Billy Liu Luke Han 于2018年10月16日周二 下午11:28写道: > > I am very pleased to announce that the Project Management Committee (PMC) of > Apache Kylin has asked Allen Ma (Gang Ma) to become Apache Kylin committer, > and he has already accepted. > >

Re: Kylin Interpreter on Zeppelin doesnt allow stting project name on paragraph

2018-09-27 Thread Billy Liu
the exception logs again. Thank you. With Warm regards Billy Liu ShaoFeng Shi 于2018年9月27日周四 上午10:50写道: > Thank you; we will check it. > > Moisés Català 于2018年9月26日周三 下午10:34写道: > >> Hi ShaoFeng, >> >> I’ve created the JIra Issue >> https://issues.apach

Re: [Announce] Apache Kylin 2.5.0 released

2018-09-19 Thread Billy Liu
to HFile in Spark [KYLIN-3441] - Merge cube segments in Spark [KYLIN-3442] - Fact distinct columns in Spark [KYLIN-3453] - Improve cube size estimation for TOPN, COUNT DISTINCT and a lot of bug fixes and improvement on stability. With Warm regards Billy Liu ShaoFeng Shi 于2018年9月19日周三 上午8:31写道

Re: [Discuss] Exclude Spark from Kylin's binary package

2018-09-18 Thread Billy Liu
I like the idea to remove the built-in spark distribution. I think Kylin could work well with all spark 2.1+ With Warm regards Billy Liu ShaoFeng Shi 于2018年9月18日周二 下午5:35写道: > > Hello, > > Today Kylin's binary package ships an Apache Spark binary, the total package > is 297

Re: [Announce] Apache Kylin 2.4.1 released

2018-09-09 Thread Billy Liu
Thanks Yanghong for this new release. With Warm regards Billy Liu Yanghong Zhong 于2018年9月10日周一 上午9:20写道: > > The Apache Kylin team is pleased to announce the immediate availability of > the 2.4.1 release. > > This is a bug fix release after 2.4.1, with 22 bug fixes and enha

Re: [Announce] New Apache Kylin PMC Yanghong Zhong

2018-08-30 Thread Billy Liu
Congrats, Yanghong. Welcome. With Warm regards Billy Liu ShaoFeng Shi 于2018年8月30日周四 下午6:04写道: > > Congratulations Yanghong! Welcome to join Kylin PMC! > > 2018-08-30 17:56 GMT+08:00 Luke Han : >> >> On behalf of the Apache Kylin PMC, I am very pleased to announce &g

Re: Changes In Dimensions And Historical Cube's Data

2018-08-21 Thread Billy Liu
-3221, you could refresh the existing lookup table as needed. With Warm regards Billy Liu Shrikant Bang 于2018年8月21日周二 上午11:26写道: > > Hello Kylin Users, > > I found a similar mail thread of Dec. 2015 ( > http://apache-kylin.74782.x6.nabble.com/Incremental-builds-assumptions-and

Re: Queries For Building Cube

2018-08-13 Thread Billy Liu
. With Warm regards Billy Liu Shrikant Bang 于2018年8月13日周一 下午5:39写道: > > Hi Team, > > We are doing a PoC on building OLAP cubes. Could you please help me to > get answer of below queries? > > Selective Cuboids: > We need to have selective cuboids as part of OLAP cubes

Re: [Announce] Apache Kylin 2.3.2 released

2018-07-08 Thread Billy Liu
Thanks, Kaisen. With Warm regards Billy Liu kangkaisen 于2018年7月8日周日 下午3:38写道: > > The Apache Kylin team is pleased to announce the immediate availability of > the 2.3.2 release. > > This is a bug fix release after 2.3.1, with 12 bug fixes and enhancements; >

Re: Kylin performance

2018-06-05 Thread Billy Liu
I just check it again. The Kybot Client download URL has been fixed. With Warm regards Billy Liu Kosmachev, Dmitry 于2018年6月5日周二 下午3:54写道: > Hi Billy! > > > > Thanks a lot! > > As I can see the first step to start using this tool is to generate > diagnostic p

Re: Kylin performance

2018-06-02 Thread Billy Liu
Hi Dmitry, This is an online query bottleneck diagnostic tools designed for Apache Kylin: https://kybot.io You could have a try, to figure out the bottleneck from underline Hbase service, or not hit the right cuboid. With Warm regards Billy Liu Kosmachev, Dmitry 于2018年5月29日周二 下午10:10写道

Re: kylin根据分区build cube,出错的job直接删除,没有执行job的DISCARDED操作,然后通过调用rest API删除没有成功的segment报错

2018-04-27 Thread Billy Liu
Agree with Silas. The job drop bug has been fixed and you are suggested to upgrade. With Warm regards Billy Liu 2018-04-24 15:17 GMT+08:00 Ge Silas <go...@live.cn>: > Hello, > > What is your Apache Kylin version? In latest versions, I don’t think the job > with error sta

Re: Hybrid Cubes Document

2018-04-22 Thread Billy Liu
Hello Roberto, Thanks for this sharing. Would you like to publish it on the Kylin website? With Warm regards Billy Liu 2018-04-20 1:18 GMT+08:00 <roberto.tar...@stratebi.com>: > Hi, > > > > Last days I was doing some researching about the use of hybrid cubes > (model

Re: [Announce] Welcome new Apache Kylin committer :Julian Pan

2018-04-16 Thread Billy Liu
Welcome Julian, congratus. With Warm regards Billy Liu 2018-04-17 9:20 GMT+08:00 Ted Yu <yuzhih...@gmail.com>: > Congratulations, Julian. > > On Mon, Apr 16, 2018 at 6:18 PM, Luke Han <luke...@apache.org> wrote: >> >> My fault, I have tried to send

[ECO] Redash Kylin Plugin

2018-04-09 Thread Billy Liu
data source." Thanks for this contribution. With Warm regards Billy Liu

Re: The global dictionary does not specify the cube distinction.

2018-04-03 Thread Billy Liu
Billy Liu 2018-04-04 9:37 GMT+08:00 小村庄 <ren...@foxmail.com>: > In the cube design, the COUNT_DISTINCT indicator USES the global dictionary. > When building a cube, a dictionary file is generated at HDFS, and the > corresponding directory is: > "/ resources/GlobalDict/dict/

Re: How to use MR to build UHC dimensions

2018-04-01 Thread Billy Liu
Hi Fei Yi, This parameter only works for ultra high cardinality columns, including the columns defined as "ShardBy" and "Global Dictionary". Please check if your cube has these two definitions. With Warm regards Billy Liu 2018-03-30 16:45 GMT+08:00 Fei Yi <yijianhui

Re: [Announce] Apache Kylin 2.3.1 released

2018-03-28 Thread Billy Liu
Download page updated. https://kylin.apache.org/download/ With Warm regards Billy Liu 2018-03-28 17:03 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com>: > Pls. advise how can I download 2.3.1 version. I don’t see there > > > > https://archive.

[Announce] Apache Kylin 2.3.1 released

2018-03-27 Thread Billy Liu
release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ With Warm regards Billy Liu

Re: negative result in kylin 2.3.0

2018-03-18 Thread Billy Liu
Hi ZhangXuan, Could you share the return type definition on your SUM measure? And also some test cases are welcomed. With Warm regards Billy Liu 2018-03-16 22:49 GMT-07:00 ZhangXuan <z...@czkj1010.com>: > Hi >Successfully built a Cube with 4 billion data on kylin upgraded

Call for contribution: Kylin Integration with Ambari

2018-03-12 Thread Billy Liu
call for contribution. If you are interested on cluster management, has skills on python/shell, has experience on Ambari project. You are the right person the community is looking for. Any suggestion is welcomed. With Warm regards Billy Liu

Re: running spark on kylin 2.2

2018-02-28 Thread Billy Liu
Any exception in logs? With Warm regards Billy Liu 2018-02-28 22:53 GMT+08:00 Sonny Heer <sonnyh...@gmail.com>: > Anyone know what I need to set in order for spark-submit to use the HDP > version of spark and not the internal one? > > currently i see: > > export HA

Re: Questions about data integrity in Kylin

2018-02-23 Thread Billy Liu
Hi BELLIER, I suggest you reading some Kylin introduction document or slide. It will explain how Kylin works, for example: https://www.slideshare.net/XuJiang2/kylin-hadoop-olap-engine With Warm regards Billy Liu 2018-02-21 19:53 GMT+08:00 BELLIER Jean-luc <jean-luc.bell...@rte-france.

Re: Use impala for intermediate table

2018-02-22 Thread Billy Liu
The release is under voting. If you want the early access, please down the package from https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.0-rc1/ With Warm regards Billy Liu 2018-02-22 23:15 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com>: > Did 2.3 version release f

Re: Holes in merge segments problem.

2018-02-17 Thread Billy Liu
Please google "apply patch", and build new binary package: http://kylin.apache.org/development/howto_package.html With Warm regards Billy Liu 2018-02-16 12:45 GMT+08:00 Prasanna <prasann...@trinitymobility.com>: > Can you please suggest me , How to use that patch. I

Re: Using several active cubes in same project

2018-02-15 Thread Billy Liu
If two cubes could answer your query at the same time, Kylin will choose the "light" cost cube. That's what happened in your case. You could disable 'cube1' manually to test the 'cube2'. If you need keep both of them active, please define them into different projects. With Warm regards

Re: Holes in merge segments problem.

2018-02-15 Thread Billy Liu
Please check if https://issues.apache.org/jira/browse/KYLIN-3048 could help With Warm regards Billy Liu 2018-02-15 21:02 GMT+08:00 Prasanna <prasann...@trinitymobility.com>: > Hi all, > > > > I used the below rest api command for getting any holes in between segments, >

New Blog: Get Your Interactive Analytics Superpower, with Apache Kylin and Apache Superset

2018-01-29 Thread Billy Liu
Thanks Joanna He and Yongjie Zhao. The blog introducing Kylin and SuperSet integration is published at http://kylin.apache.org/blog/2018/01/01/kylin-and-superset/ Please have a try, and share your experience with Kylin community.

Re: Towards Kylin 2.3

2018-01-28 Thread Billy Liu
Here is the entry point: https://issues.apache.org/jira/browse/KYLIN 2018-01-29 13:16 GMT+08:00 Kumar, Manoj H <manoj.h.ku...@jpmorgan.com>: > Not yet I have not raised it.. Pls. let me know the Jira link, I will do > that. > > > > Regards, > > Manoj > >

Re: Towards Kylin 2.3

2018-01-28 Thread Billy Liu
n Kylin. > > > > > > Regards, > > Manoj > > > > *From:* Billy Liu [mailtobilly...@apache.org] > *Sent:* Monday, January 29, 2018 10:36 AM > *To:* dev <d...@kylin.apache.org>; user <user@kylin.apache.org> > *Subject:* Towards Kylin 2.3 > > > > H

Kylin Meetup Slides

2018-01-28 Thread Billy Liu
are Chinese, sorry for the inconvenience) Billy Liu

Towards Kylin 2.3

2018-01-28 Thread Billy Liu
Hello Kylin Dev & User community, Last Kylin 2.2.0 release was on 3rd Nov 2017, three months ago. I'd like to propose the next 2.3.0 release in the middle of Feb 2018. I volunteer to be the release manager. We already resolved 200+ issues during 2.3.0 developing cycle and many exciting features.

Re: Use kylin 2.2.0 on HBase 0.98 and Hive 0.13

2018-01-25 Thread Billy Liu
This is no binary build for HBase 0.98. You could package your own Kylin against HBase 0.98. 2018-01-26 9:42 GMT+08:00 苏启龙 : > > Hi guys, > > We are currently using kylin 1.6.0 on with a cluster with CDH 5.2, which > hbase version is 0.98, and hive version is 0.13. Now we’d

Re: MDX queries on kylin cubes.

2018-01-18 Thread Billy Liu
Do you want to have a try on this? http://dekarlab.de/wp/?p=363 2018-01-17 12:36 GMT+08:00 Prasanna : > Hi all, > > > > I am using kylin 2.2.0 version. Present I am using only sql type queries > on kylin cubes like select with aggregation functions. I would

Re: Re: Support embedded JSON format ?

2018-01-15 Thread Billy Liu
When you say somehting is wrong, please leave complete log for that error. 2018-01-15 17:26 GMT+08:00 ShaoFeng Shi : > Only replace jar in tomcat may not work; please rebuild a new binary > package. > > 2018-01-15 16:43 GMT+08:00 446463...@qq.com <446463...@qq.com>: > > >

Re: cachesync.Broadcaster:172 : error running wiping java.lang.IllegalArgumentException

2018-01-09 Thread Billy Liu
ad.start(Thread.java:717) > at java.lang.ref.Reference.(Reference.java:232) > > > > > > [2] > > > > export KYLIN_JVM_SETTINGS="-Xms2g -*Xmx16g* -Xss2g -XX:MaxPermSize=256M > -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps > -Xloggc:$KYLIN_H

Re: cachesync.Broadcaster:172 : error running wiping java.lang.IllegalArgumentException

2018-01-08 Thread Billy Liu
Hello Ruslan, Could you check the "kylin.server.cluster-servers". There should no "http://; as prefix. 2018-01-09 0:59 GMT+08:00 Ruslan Dautkhanov : > Below error crashes Kylin. > Attempts to start Kylin back results in the same exception. > This started happening after a

Re: superset Kylin connector

2017-12-28 Thread Billy Liu
Thank you, Joanna. Very interesting project, the community is expecting more integration between SuperSet and Kylin. Could you like to share more use cases on SuperSet application? Maybe we could publish it through Kylin blog. 2017-12-29 14:05 GMT+08:00 Joanna He : > Hello

Re: Does kylin support Hadoop 3.0?

2017-12-22 Thread Billy Liu
Not yet, but there are some contributors working on that. The gap is very small as I know. 2017-12-22 10:34 GMT+08:00 jxs : > Hi, kylin developers, > > My colleage is building a new small cluster with hadoop 3.0, since the > version 3.0 is just released, I am wondering if kylin

Re: Re: Re: How to config kylin to use kerberized hadoop cluster

2017-12-17 Thread Billy Liu
kerberized version of its own? > > > > > At 2017-12-18 14:23:29, "Billy Liu" <billy...@apache.org> wrote: > > kylin.job.status.with.kerberos=true has been deprecated since > https://issues.apache.org/jira/browse/KYLIN-1319, and code removed recently. > > p

Re: Re: Strange HBase rpc operation timeout error

2017-12-17 Thread Billy Liu
eady response time (in a range not two bad, eg: within 1 > minute) is somehow acceptable. > The previous timeout error just interrupted the cube building procedure, > we don't wan't that. > What is your suggestion for this use case? > > > > 在2017年12月16 11时48分, "Billy Liu&

Re: Strange HBase rpc operation timeout error

2017-12-15 Thread Billy Liu
Check this: http://apache-kylin.74782.x6.nabble.com/hbase-configed-with-fixed-value-td9241.html 2017-12-15 18:03 GMT+08:00 jxs : > Hi, > > Finally, I found this in org.apache.kylin.storage. > hbase.HBaseResourceStore: > > ``` > private StorageURL buildMetadataUrl(KylinConfig

Re: kylin1.6 集群有些时候创建cube不能同步到其他节点上

2017-12-14 Thread Billy Liu
Hello Chenping, Quite a few metadata sync related issues are resolved recently, including: https://issues.apache.org/jira/browse/KYLIN-2834 https://issues.apache.org/jira/browse/KYLIN-2858 https://issues.apache.org/jira/browse/KYLIN-2834 You are strongly suggested to upgrade to the latest Kylin

Re: Kylin Hue Integration Blog

2017-12-14 Thread Billy Liu
Very useful. Thanks, Joanna. I will we could repost it on the Kylin website also. 2017-12-14 18:04 GMT+08:00 JHe : > we have recently explored integrating kylin with Hue and have contributed > a blog to hue community. > > In this blog, we explained how you can integrate kylin

Re: A problem about retention rate analyze

2017-12-07 Thread Billy Liu
This is not by design, could you show more exception logs? 2017-12-07 16:22 GMT+08:00 skyyws : > Hi guys, > I found that kylin supported retention rate analyze function, so I made > some test for this function. The following SQL executed successful: >

Re: kylin service is getting down frequently!

2017-12-05 Thread Billy Liu
Hi Prasana, What kinds of queries you were using? If you issued some "select *" to very huge table, it may cause OOM. Kylin is designed to answer OLAP-style queries very fast, but not detailed query. Could you check again? 2017-12-04 21:12 GMT+08:00 Ge Silas : > Hello, > > Can

Re: [Discuss] Disable/hide "RAW" measure in Kylin web GUI

2017-11-28 Thread Billy Liu
ink it is time to disable the RAW measure on Kylin now. JIRA >> created for it: https://issues.apache.org/jira/browse/KYLIN-3062 >> >> Please comment if you see any issue. >> >> 2016-12-19 22:03 GMT+08:00 Billy Liu <billy...@apache.org>: >> >> > The ex

Re: Build cube and streaming cube problems

2017-11-24 Thread Billy Liu
I suggest you seperating different questions into sepearted mail thread. That makes the dicussion more focus. Kylin is designed of OLAP queries which is aggreated query, not for RAW data. Although it has a workaround solution for RAW measure. I am not sure if it works for dozen columns. Maybe you

Re: Can hierarchyDims contain jointDims

2017-11-20 Thread Billy Liu
Hi Doom, Thank you for reading the code so carefullly. You are welcomed to contribute on this JIRA. 2017-11-19 16:42 GMT+08:00 doom <43535...@qq.com>: > So this issues is work in progress, and result in the two piece contradict > code. thank you for make me clear. > > > -- 原始邮件

Re: 如何在本地Windows环境下搭建kylin本地运行环境

2017-11-16 Thread Billy Liu
Hello, If you follow the doc, but meet some problems, please describe your steps and results(better with snapshot) in the mail. Then others will know where you are, and if in the wrong way. 在 2017年11月17日 上午10:35,Hey <1428117...@qq.com>写道: > 按照kylin官网来是可以的 ,需要nodejs下载kylin

Re: how to change the order of rowkey_columns

2017-11-14 Thread Billy Liu
You could change the rowkey order by drag-and-drop from GUI directly. 2017-11-14 10:52 GMT+08:00 杨浩 : >To speed up the query, we should position the frequent column before > others, such as partition column date should be at the first for every > query would contain it.

Re: Set up Development environment at intelliji

2017-11-12 Thread Billy Liu
Hi Kumar, Coudl you check out this doc first http://kylin.apache.org/development/dev_env.html ? 2017-11-12 23:45 GMT+08:00 Kumar, Manoj H : > Can you pls. give step by step to do Dev. Set up of Apache Kylin? Since I > am not from Java Background, Pls. give the

Re: About degenerate dimensions on Kylin cubes

2017-11-09 Thread Billy Liu
Hi Roberto, Degenerate dimensions on fact table is not supported I think. There is only two types dimensions: "normal" and "derived". All "normla" dimensions will be precaculated into cube. So it affects the construction cost and query latency. If some column in fact table do not need to be

Re: Kylin 2.1.0 new features than old versions.

2017-11-09 Thread Billy Liu
I will suggest waiting a few days. I know the bug has been fixed recently. But the code has not merged into master yet. 2017-11-09 14:29 GMT+08:00 Prasanna : > Hi all, > > > > Present I am using kylin 1.6.0 . If anybody is using kylin latest version > 2.X ,can

Re: How to drop the segments

2017-11-08 Thread Billy Liu
http://kylin.apache.org/docs21/howto/howto_use_restapi.html Delete Segment DELETE /kylin/api/cubes/{cubeName}/segs/{segmentName} 2017-11-09 14:56 GMT+08:00 Kumar, Manoj H : > Can you pls. tell how to drop the Cube segment from backend? While > re-running the Cube

Re: Export and Import metadata between Kylin clusters

2017-11-02 Thread Billy Liu
this unresolved JIRA. KYLIN-1605 > <https://issues.apache.org/jira/browse/KYLIN-1605> > > I mean the posibility of migrate metadata from source, data model, cube > definition or all project in order to re build the all cube, e.g. with > different Hadoop cluster. > > Thank

Re: Re: kylin2.1 can't work with hdp2.6.0

2017-11-02 Thread Billy Liu
> > *发件人:*ShaoFeng Shi <shaofeng...@apache.org> > *发送时间:*2017-10-31 16:07 > *主题:*Re: kylin2.1 can't work with hdp2.6.0 > *收件人:*"user"<user@kylin.apache.org> > *抄送:* > > Since 2.1, Kylin consolidates the metadata into one HBase

Re: kylin2.1 can't work with hdp2.6.0

2017-10-30 Thread Billy Liu
Could you check the kylin.log first? 2017-10-31 10:55 GMT+08:00 lk_kylin : > hi,all: >I want try kylin , my hadoop version is hdp2.6 , I can run the sample > by useing kylin2.0 . but when I try 2.1 with sample, kylin can't load hive > table and I found it only create one

Re: Export and Import metadata between Kylin clusters

2017-10-23 Thread Billy Liu
Hi Shaofeng, Do you think the CubeMetaExtractor and CubeMetaIngestor could do the this job? 2017-10-23 22:51 GMT+08:00 ShaoFeng Shi : > BTW, would you like to report a JIRA for this? thanks. > > 2017-10-23 22:51 GMT+08:00 ShaoFeng Shi : > >> I

Re: [外部邮件] Re: [外部邮件] 回复:kylin drop cube segment Htable 仍然存在

2017-10-18 Thread Billy Liu
Agree. A new patch is needed in KYLIN-2846. It's not a bug still, but an unfinished improvement I think. Let's continue to improve this issue. 2017-10-18 21:05 GMT+08:00 ShaoFeng Shi : > Hi Yaowu, > > Could you please update this patch in KYLIN-2846? Storage cleanup

Re: Persistent error after Kafka streaming cube source stopped

2017-10-16 Thread Billy Liu
Hi Roberto, Could you update more logs. It should has more logs from the context. 2017-10-16 17:19 GMT+08:00 Roberto Tardío : > Hi, > > I'm doing a PoC with to build a cube with Kylin using a Streaming Data > with Kafka. Kafka connection and cube creation works

Re: 关于kylin设置queuename遇到的问题

2017-10-16 Thread Billy Liu
Seems like a bug, could you open a JIRA for this? 在 2017年10月16日 下午5:47,wanglb 写道: > 最近在cdh5.7搭建kylin2.1环境后,构建cube时遇到问题 > > 需要修改队列名称 > 在kylin.properties文件配置队列参数如下: > kylin.source.kylin.client=beeline > kylin.engine.mr.config-override.mapreduce.job.queuename = root.cbasQueue >

Re: Kafka Streaming data - Error while building the Cube

2017-10-13 Thread Billy Liu
And in Kylin tutorial, the topic is kylindemo, in your sample, the topic is kylin_demo. Please double check the topic name. 2017-10-13 14:27 GMT+08:00 Billy Liu <billy...@apache.org>: > If you could package the source code, please try to add more debug log > when retrieving pa

Re: cannot file ojdbc6.jar while kylin startup

2017-10-12 Thread Billy Liu
You could ignore the boring message. That's tomcat tries to detect ODBC libraries from environment. Not real Kylin error. 2017-10-12 17:19 GMT+08:00 li...@fcyun.com : > > Hi, all > > Here my logs in kylin.out file. why this error ocuurs? > > > Another confusion, while I start

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
ssl.secure.random.implementation = null > > ssl.trustmanager.algorithm = PKIX > > ssl.truststore.location = null > > ssl.truststore.password = null > > ssl.truststore.type = JKS > > value.deserializer = class org.apache.kafka.common.serialization. > StringDese

Re: Merge Segment ERROR

2017-10-12 Thread Billy Liu
Fixed at https://issues.apache.org/jira/browse/KYLIN-2794, and will be released in Apache Kylin 2.2 2017-10-11 15:41 GMT+08:00 s丶影中人* <845286...@qq.com>: > When i merge the segment encounter error, how can i solve it. Please... > Log as follows: > > 2017-10-11 15:24:56,139 ERROR

Re: Kafka Streaming data - Error while building the Cube

2017-10-12 Thread Billy Liu
Hi Kumar, Could you paste more Kafka Consumer related log in kylin.log? And also check from the Kafka broker side, if the Kylin client has connected to Broker. 2017-10-12 14:29 GMT+08:00 Kumar, Manoj H : > Building the Cube from Kylin UI - Although Messages are there

Re: query return error result.

2017-10-11 Thread Billy Liu
Nice found. +1 2017-10-11 15:08 GMT+08:00 yu feng : > I checked the code, and find root cause is DumpMerger.enqueueFromDump() > > I create a jira KYLIN-2926 > to trace the bug. > > > > 2017-10-09 10:37 GMT+08:00 yu feng

Re: How to merge cube segments with holes?

2017-10-10 Thread Billy Liu
Another workaround is to trigger PUT kylin/api/cubes/AnalyticsCube/holes to fill up the holes. 2017-10-10 18:01 GMT+08:00 Billy Liu <billy...@apache.org>: > The code is a little old. Could you have a try on the latest 2.1? > > 2017-10-09 15:41 GMT+08:00 <prasann...@t

Re: How to merge cube segments with holes?

2017-10-10 Thread Billy Liu
in/api/cubes/trinityAnalyticsCube/rebuild > > > > *EXCEPTION:* > > > > {"url":"http://ipaddress:7070/kylin/api/cubes/AnalyticsCube/rebuild","exception":"Merging > segments must not have holes between > AnalyticsCube[2017070100_

Re: apache-kylin-2.1.0-bin-cdh57.tar.gz

2017-10-09 Thread Billy Liu
The CDH57 works for all CDH 5.7+ 2017-10-10 2:35 GMT+08:00 Ruslan Dautkhanov : > From the Downloads page I can only see apache-kylin-2.1.0-bin-cdh*57*. > tar.gz > Are there more current builds .. like for CDH 5.*12*? > If not, does it make sense to build Kylin myself? (not

Re: How to merge cube segments with holes?

2017-10-08 Thread Billy Liu
geEmptySegment\"])\n at [Source: > org.apache.catalina.connector.CoyoteInputStream@61b3d534; line: 1, > column: 87] (through reference chain: org.apache.kylin.rest.request. > JobBuildRequest[\"isForce\"])"} > > > > > > I tried with force=true parameter also, its g

Re: How to merge cube segments with holes?

2017-10-03 Thread Billy Liu
10255ad; line: 1, column: > 15]; nested exception is com.fasterxml.jackson.core.JsonParseException: > Unexpected character (',' (code 44)): expected a valid value (number, > String, array, object, 'true', 'false' or 'null')\n at [Source: > org.apache.catalina.connector.CoyoteInputStream@10255ad;

Re: How to merge cube segments with holes?

2017-10-03 Thread Billy Liu
The merge API has one parameter named isForce in JobBuildRequest. Could you set it to true and try again? 2017-10-03 20:25 GMT+08:30 : > Hi all, > > > > Anybody have any idea about how to merge cube segments with hole. if I > tried to merge its giving as, > > > >

Re: Re: Segment overlap when merge

2017-09-28 Thread Billy Liu
> "DEFAULT.KYLIN_CATEGORY_GROUPINGS" : "/table_snapshot/ > DEFAULT.KYLIN_CATEGORY_GROUPINGS/b3875fd4-44a5-4100- > bf08-7d54e307cf8b.snapshot" > }, > "rowkey_stats" : [ [ "LEAF_CATEG_ID", 134, 1 ], [ " > META_CATEG_NAME&quo

Re: Segment overlap when merge

2017-09-27 Thread Billy Liu
The metadata has the wrong segments already. If you dump out the metadata, should figure out one of that segments is invalid. Remove that segment and restore the metadata. 2017-09-28 11:59 GMT+08:00 luoyong...@yaochufa.com : > > Hi: > kylin causes an

Re: Kylin and SuperSet

2017-09-12 Thread Billy Liu
Kylin is driven by the community. If some proposal or patch working on this task, the new feature will be ready soon. The community will be excited if we have this integration, but no actual effort yet. I saw some prototypes on the integration between Apache Kylin and SuperSet on some customer's

Re: Query across different MODEL/CUBES

2017-09-06 Thread Billy Liu
It sounds like a HINT in SQL. 2017-09-06 17:51 GMT+08:00 Yuxiang Mai : > Hi,all > > We have some questions about query across different model/cubes. We know > that kylin will evaluate the cost and select the best cube to query. In > our usage, this worked very good. But

Re: different mr config for different project or cube

2017-09-05 Thread Billy Liu
You could override the default MR config on the project level or cube level through the GUI, not the file. 2017-09-06 10:11 GMT+08:00 yu feng : > I remember Kylin support use different mr config file for different > project, like KYLIN-1706 >

Re: Can KYLIN support select if ... from SQL?

2017-09-01 Thread Billy Liu
Mai <yuxiang@gmail.com>: > Thanks.. > > We will try it. > > BTW, any drawbacks if we directly use in a where condition? > > > > On Fri, Sep 1, 2017 at 11:37 PM, Billy Liu <billy...@apache.org> wrote: > >> The suggested way is to define new column

Re: 答复: where OPS_REGION=lower('Shanghai') ERROR

2017-08-31 Thread Billy Liu
Could you file a JIRA to track this issue? 2017-08-24 11:44 GMT+08:00 程 万胜 <chivise...@hotmail.com>: > it's fine if no LOWER function used! > > -- > *发件人:* Billy Liu <billy...@apache.org> > *发送时间:* 2017年8月24日 10:44 > *收件人:* user >

Re: count_distinct_if, count_if and sum_if

2017-08-28 Thread Billy Liu
This kinds of contribution is very welcomed. Could you send your issue to dev mailer, the community will help you. 2017-08-28 21:40 GMT+08:00 Alexander Sterligov : > Hi! > > It would be nice to have if-functions in kylin. What do you think? > > I've already implemented

Re: where OPS_REGION=lower('Shanghai') ERROR

2017-08-23 Thread Billy Liu
What happened if no LOWER function used? 2017-08-21 11:05 GMT+08:00 程 万胜 : > hello all: > > > error log: > > > 2017-08-21 10:26:32,624 INFO [Query 4bb70ccb-68e7-4b11-965f-e3d8e8bfd5d9-82] > service.QueryService:366 : Using project: learn_kylin > 2017-08-21 10:26:32,625

  1   2   >