Re: Cassandra?

2016-09-13 Thread Billy(Yiming) Liu
https://community.mapr.com/docs/DOC-1558 There is a document introducing run Kylin on MapR. HBase is the mandatory component. 2016-09-13 14:43 GMT+08:00 Something Something : > One of my clients uses MarR distribution & they don't use HBase. We tried > using Kylin with MapR tables & it didn't wo

Re: which cube to use when u build many cubes under a model

2016-09-13 Thread Billy(Yiming) Liu
Kylin has a cost-based router algorithm to find the lowest cost cube to serve the query. 2016-09-13 15:04 GMT+08:00 Mars J : > Hi , > I'm every curious about that if I define and build many cubes under > one specific model, e.g cube1,cube2,cube3, these cubes may have same > dimensions, so if

Re: How does Kylin communicate with underlying Hadoop services ?

2016-09-14 Thread Billy(Yiming) Liu
Hive is the data source, not the query engine for Kylin. Kylin is the query engine itself. The Hive command you found is the command to retrieve the data source, not user query. 2016-09-14 10:42 GMT+08:00 udana pathirana : > So basically you execute Beeline or Hive command to send queries to > Hi

Re: [Announce] Apache Kylin 1.5.4 released

2016-09-16 Thread Billy(Yiming) Liu
Thanks Shaofeng and our community. 2016-09-16 21:25 GMT+08:00 ShaoFeng Shi : > The Apache Kylin team is pleased to announce the immediate availability of > the 1.5.4 release. > > This is a bug fix release based on 1.5.3; All of the changes in this > release can be found in: > https://kylin.apache

Re: Kylin and BI Tools

2016-09-19 Thread Billy(Yiming) Liu
So cool, impressive. Thank you, Alberto. 2016-09-19 21:42 GMT+08:00 Alberto Ramón : > Hello > > This is the end of all my previous articles, about Kylin and differents > tools > With some successful and some failures :) > > > https://github.com/albertoRamon/Kylin/tree/master/KylinWithMain > > >

Re: Sample Cube Building Error during #4 Step Name: Build Dimension Dictionary

2016-09-21 Thread Billy(Yiming) Liu
The function initializeSerDe introduced by Hive 1.0+, it seems some old hive libraries exist in the $hive_dependency. 2016-09-21 13:47 GMT+08:00 Sunwei : > Hi all: > > I'm using *apache-kylin-1.5.4-HBase1.x-bin* with* hadoop2.6.4 Hive1.2.1 > Hbase1.1.4*. > > When i build the sample cube "kyli

Re: group by on varchar column

2016-09-21 Thread Billy(Yiming) Liu
So, you hit this bug, https://issues.apache.org/jira/browse/KYLIN-1971 2016-09-21 19:41 GMT+08:00 Sandeep Khurana : > Found the issue, when fact and dimension have same column names on which > group by is being done then this problem occurs. I removed similar named > column from the fact table. >

Re: [Award] Kylin won InfoWord Bossie Awards 2016, again!

2016-09-22 Thread Billy(Yiming) Liu
So cool. Congrats. 2016-09-23 11:09 GMT+08:00 Hao Chen : > Congratulation! > > Hao > > On Sep 23, 2016, at 12:35 AM, Luke Han wrote: > > Hi community, > You may already know, in the latest announced news from InfoWorld, > Apache Kylin has been selected for this year's Bossie Awards again: >

Re: [Announce] Apache Kylin 1.5.4.1 released

2016-09-28 Thread Billy(Yiming) Liu
Thanks Shaofeng. Release is a hard work. 2016-09-28 17:34 GMT+08:00 ShaoFeng Shi : > The Apache Kylin team is pleased to announce the immediate availability of > the 1.5.4.1 release. > > This is a bug fix release based on 1.5.4; All of the changes in this > release can be found in: > https://kyli

Re: SQuirrieL and Kylin

2016-10-16 Thread Billy(Yiming) Liu
Thanks, Alberto. Nice work. 2016-10-15 19:21 GMT+08:00 Alberto Ramón : > Hello > > I Wrote a Tech note > , > about use "SQuireL: Universal SQL Client ", > with Apache Kylin > > I used a lot for testi

Re: Read Apache Kylin from Apache Flink

2016-10-18 Thread Billy(Yiming) Liu
Really cool. Thank you for the contribution. 2016-10-19 1:40 GMT+08:00 Alberto Ramón : > Hello > > I made a small contribution / manual about: > *"How-to Read Apache Kylin data from Apache Flink With Scala" > * > > > > > For

Re: which hdfs should the property "kylin.hdfs.working.dir" point to when deploying kylin with standalone hbase cluster

2016-10-25 Thread Billy(Yiming) Liu
use kylin.hbase.cluster.fs 2016-10-26 9:46 GMT+08:00 于奎星 : > hi > > > now I'm trying this: http://kylin.apache.org/blog/2016/06/10/standalone- > hbase-cluster/ > > > and I'm not sure which hdfs the property "kylin.hdfs.working.dir" should point > to, hdfs in main cluster or hdfs in hbase cluter?

Re: Build times gone up!

2016-10-27 Thread Billy(Yiming) Liu
Hi Joel, If memory build algorithm is used, the steps for layered build would be skipped, such like "Build N-Dimension". All build actually happens at "Build Cube". 2016-10-28 2:09 GMT+08:00 Joel Victor : > We are seeing a problem in our cube builds that our build times have gone > up. In betwee

Re: Kylin Dependencies

2016-11-02 Thread Billy(Yiming) Liu
Here is a quick start for running Kylin on docker, https://github.com/kyligence/kylin-docker >From the docker file, you could find the kylin dependencies. 2016-11-02 22:46 GMT+08:00 Alberto Ramón : > With configs ... I can try it (Will be an interesting exercise for me) > But libraries, ...

Re: query hbase table data from kylin

2016-11-15 Thread Billy(Yiming) Liu
Kylin supports Hive and Kafka as data source, not HBase. As a workaround, maybe you could find some tools to transfer the data from HBase to Hive first. 2016-11-16 12:21 GMT+08:00 夏天松 : > hi kylin team, > the version of kylin is 1.5.3 > Now I want to use kylin as our data warehouse, but I want to

Re: some confuse about Mandatory Dimensions

2016-11-16 Thread Billy(Yiming) Liu
If you set A, B, and C as mandatory dimensions, that means Kylin will save the cuboid result by grouping A, B, C internally. But that not means you could only query by grouping A, B, C. If you only query A, B. The final result will do post-aggregation by grouping the above cuboid. Same as query gr

Re: build cube step 3 error

2016-11-16 Thread Billy(Yiming) Liu
Kylin depends on Hadoop 2.6 and Yarn 2.6 API. Please check if the Kylin version match your hadoop distribution. 2016-11-17 11:14 GMT+08:00 ShangYong Li(李尚勇) : > Kylin-1.5.4.1 Build cube step 3 error, can anyone please help me > understand the issue and how to fix it? > > java.lang.NoSuchMethodErr

Re: Build Erro in Step : Build Dimension Dictionary

2016-11-19 Thread Billy(Yiming) Liu
Please check if the step before build dimension has finished successfully. 2016-11-18 18:54 GMT+08:00 Mars J : > I get this error of message :" java.lang.NullPointerException > result code : 2" > > there is no more messages in the kylin.log. > > Is anyone met this problem ? > -- With Warm reg

Re: Build Erro in Step : Build Dimension Dictionary

2016-11-22 Thread Billy(Yiming) Liu
just in the dimension > table. > > 在 2016年11月19日,下午7:57,Billy(Yiming) Liu 写道: > > Please check if the step before build dimension has finished successfully. > > 2016-11-18 18:54 GMT+08:00 Mars J : > >> I get this error of message :" java.lang.NullPointerException >&

Re: Consulting "EXTENDED_COLUMN"

2016-11-30 Thread Billy(Yiming) Liu
Thanks, Alberto. The explanation is accurate. EXTENDED_COLUMN is only used for representation, but not filtering or grouping which is done by HOST_COLUMN. So EXTENDED_COLUMN is not a dimension, it works like a key/value map against the HOST_COLUMN. If the value in EXTENDED_COLUMN is not long, you

Re: Consulting "EXTENDED_COLUMN"

2016-12-01 Thread Billy(Yiming) Liu
PB: You can't filter / Group by Txt > > SOL2: Joint. Define tuples of ID & TXT > Some PB/limitation? (I need test this option) > > 2016-12-01 0:35 GMT+01:00 Billy(Yiming) Liu : > >> Thanks, Alberto. The explanation is accurate. EXTENDED_COLUMN is only >>

Re: Consulting "EXTENDED_COLUMN"

2016-12-02 Thread Billy(Yiming) Liu
tion, with support > for filters and Group by > > 2016-12-01 11:55 GMT+01:00 Billy(Yiming) Liu : > >> The cost of joint dimension compared with extended column is you have >> more columns in the HBase rowkey. It may harm the query performance. But >> most time, joint dime