Re: Bump KYLIN-976

2015-12-09 Thread Li Yang
uot;Adunuthula, Seshu" <sadunuth...@ebay.com> wrote: > > > > >This is awesome! > > > > > >On 12/8/15, 6:05 AM, "Shi, Shaofeng" <shao...@ebay.com> wrote: > > > > > >>This is another important refactor since making the bui

Re: Xianbin volunteers to work on KYLIN-1079

2015-12-10 Thread Li Yang
Welcome Xianbin~ On Tue, Dec 8, 2015 at 3:25 PM, whenwin wrote: > hi all! > > thank for the warm welcome, and help from hongbin, xiaoyu, luke. > > big smile on face! > > regards > > -- > View this message in context: >

Re: Re: about the parameter 'acceptPartial'

2016-01-05 Thread Li Yang
You don't need to set it up in JDBC, it's false by default. On Tue, Jan 5, 2016 at 6:10 PM, wangsh...@sinoaudit.cn < wangsh...@sinoaudit.cn> wrote: > Yes, how can I do? > > > > wangsh...@sinoaudit.cn > > From: Li Yang > Date: 2016-01-05 17:29 > To: dev &

Re: Re: encouter Deserialization error when load hive table

2015-12-31 Thread Li Yang
> Task Id : attempt_1450856278246_0003_m_00_0, Status : FAILED So this is an error on a MR node. Likely the hive versions are not consistent across your cluster. A work around is let Kylin submit hive jars as part of MR job. See https://issues.apache.org/jira/browse/KYLIN-1021 On Wed, Dec

Re: suggest to revise kylin log preamble format

2016-01-06 Thread Li Yang
Still need month and date for copy and paste lines here and there. Others are great. On Thu, Jan 7, 2016 at 10:22 AM, hongbin ma wrote: > the reason to remove date info is that our kylin-server-log4j properties > uses DailyRollingFileAppender, putting date info in such

Re: Incremental builds assumptions and clarifications

2015-12-24 Thread Li Yang
Em.. don't think Luke has all the questions fully answered. My additions. >Is there a document explaining the assumptions for incremental builds. The only assumption (or requirement) is that there is date or timestamp column on the fact table that distinguishes the old from the new. >Do

Re: HBase 1.1 support

2015-12-27 Thread Li Yang
I'm merging 1.x-staging (which contains all latest stuff included in 1.2) to 1.x-HBase1.1.3 periodically. Drop a reminder in mailing list if you see 1.x-HBase1.1.3 is lag behind. Usually it will catch up pretty soon. On Thu, Dec 17, 2015 at 11:02 PM, Luke Han wrote: > here

Re: [ANNOUNCE] Apache Kylin 1.2 released

2015-12-24 Thread Li Yang
> nice, we long for the following 2 improvements for a long time: > [KYLIN-389] - Can't edit cube name for existing cubes > [KYLIN-1154] - Load job page is very slow when there are a lot of history job Ashamed that some basic function is finally fixed. But glad that we continue to improve. :-)

Re: Apache软件基金会宣布Apache Kylin成为顶级项目

2015-12-24 Thread Li Yang
用力鼓掌!!! 2015-12-13 13:30 GMT+08:00 Luke Han : > Here's Chinese translation of ASF announces Apache Kylin as a Top-Level > Project [1]. > 这是Apache基金会宣布Apache Kylin成为顶级项目新闻的中文翻译 > > Great thanks to Luwei Chen who did this. > 感谢陈露薇翻译这篇文章 > > [1]. >

Re: ApplicationNotFoundException

2015-12-30 Thread Li Yang
Seems a hadoop problem... On Mon, Dec 28, 2015 at 3:49 PM, 胡志华(万里通科技及数据中心商务智能团队数据分析组) < huzhihua...@pingan.com.cn> wrote: > Hi,all > > I stopped at step 14 “ Convert cuboid data to HFile” with > exception ApplicationNotFoundException, who can help me ? > > >

Re: encouter Deserialization error when load hive table

2015-12-29 Thread Li Yang
Try hive command from the Kylin node, does simple hive queries work? On Thu, Dec 24, 2015 at 2:03 PM, xianbin wang wrote: > anyone have a idea for such a error,when load hive table, error as follow: > > L4J [2015-12-24

Re: 答复: sample.sh running error

2015-12-29 Thread Li Yang
Need the full kylin.log to pin down the issue. Apparently Kylin is not accessing the hbase you think it should.

Re: A problem,maybe a bug, when querying in kylin using not in

2016-01-12 Thread Li Yang
> FROM "BD_WAREHOUSE"."KYLIN_VIEW_TVAD_SUMMARY" "KYLIN_VIEW_TVAD_SUMMARY" > LEFT JOIN "BD_WAREHOUSE"."KYLIN_TV_DIM_AREA" "KYLIN_TV_DIM_AREA" > ON ("KYLIN_VIEW_TVAD_SUMMARY"."AREA" = > "KYLIN_TV_DIM_

Re: Cube build error - file kylin_job_meta does not exist

2016-01-12 Thread Li Yang
Seems your hadoop has a problem when copying distributed cache. However not sure of the best way to troubleshoot the problem. Maybe try a simpler MR job that involves distributed cache? On Fri, Jan 8, 2016 at 7:05 AM, Jiunn Jye Ng wrote: > Hi, > I am trying out Kylin 1.2.

Re: A error at cube build. @ #3 Step Name: Build Dimension Dictionary Duration: 0.03 mins

2016-06-02 Thread Li Yang
Please open a JIRA with the reproduce steps. Thanks. On Tue, May 24, 2016 at 10:30 AM, 陈佛林 <chenfo...@gmail.com> wrote: > Yeah, the problem reproduces > > 2016-05-22 9:55 GMT+08:00 Li Yang <liy...@apache.org>: > > > Source code at the line is > > > >

Re: Merge cube and build cube simultaneously

2016-06-07 Thread Li Yang
This is valid requirement, could you open a JIRA? On Wed, Jun 1, 2016 at 6:47 PM, Vaibhav Taro wrote: > Right now with Kylin 1.5.2, it is not possible to run Cube merge for old > segments and Cube build job for a new segment simultaneously. (I am not > able to run cube

Re: 回复:failed to start kylin server

2016-06-07 Thread Li Yang
@耳东, according to the log, Kylin failed to read metadata during startup. Please check HBase is on and healthy. Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=6, exceptions: Sun May 29 02:02:19 CST 2016, null, java.io.InterruptedIOException: Origin:

Re: Extract Fact Table Distinct Columns step taking more time

2016-06-07 Thread Li Yang
Need to identify why "step-2" is slow first. Maybe start by checking if the mapper splits are even. On Thu, Jun 2, 2016 at 5:25 PM, Vaibhav Taro wrote: > Hey, ShaoFeng thanks for the reply. Yes, my Kylin version is 1.5.2. > > I have consistently observed that step-2

Re: a simple question about kylin input and output

2016-06-07 Thread Li Yang
I'm more curious about the purpose of such requirement. It's not obvious to me. On Thu, Jun 2, 2016 at 6:55 PM, lidong wrote: > Does Hive view meet your need? > > > Create a Hive view C base on A join B. And make C as input, then get C as > output. > > > Thanks, > Dong > > >

Re: 答复: 答复: how to extend the threshold for kylin query?(from baixing.com)

2016-06-08 Thread Li Yang
.budget=64424509440 > #default is 3G > kylin.query.cube.visit.timeout.times=3 > #default is 1 > > > > B.R > Austin.Woo > > -邮件原件- > 发件人: Li Yang [mailto:liy...@apache.org] > 发送时间: 2016年6月7日 8:55 > 收件人: dev@kylin.apache.org > 抄送: 李欣 <li...@baixing.com&

Re: How to name derived dimensions & hierarchy dimensions in Chinese

2016-06-08 Thread Li Yang
You can have a name mapping outside of Kylin. On Wed, Jun 8, 2016 at 10:47 AM, 251469031 <251469...@qq.com> wrote: > Hi all: > > > I want to display the cube metadata by calling the RESTful API of > kylinhost:7070/api/cubes/{cubeName} so that the endusers can know the cube > details, as the

Re: select * from fact_table

2016-06-07 Thread Li Yang
赵天烁 Kevin Zhao > Java工程师 研发中心-Flyme-大数据-平台研发 + 86 18826908281 | zhaotians...@meizu.com > 珠海市魅族科技有限公司 MEIZU Technology Co., Ltd. 广东省珠海市科技创新海岸魅族科技楼 MEIZU Tech Bldg., > Technology Innovation Coast Zhuhai, 519085, Guangdong, China meizu.com > -邮件原件- 发件人: Mars J [mail

Re: How to name derived dimensions & hierarchy dimensions in Chinese

2016-06-11 Thread Li Yang
nsions in > the future or not? > > > > > > > ------ 原始邮件 -- > 发件人: "Li Yang";<liy...@apache.org>; > 发送时间: 2016年6月8日(星期三) 下午5:34 > 收件人: "dev"<dev@kylin.apache.org>; > > 主题: Re: How to name derived dimensions & hierarchy di

Re: snapshot table not update

2016-06-11 Thread Li Yang
To confirm understanding. You built a cube, updated the lookup table in hive, and built it again. And the second build didn't pick up the latest lookup table. Is that correct? On Wed, Jun 8, 2016 at 11:45 AM, yubo-...@yolo24.com wrote: > I define a loopup table in a

Re: mvn install error

2016-06-13 Thread Li Yang
Kylin requires JDK 7. Seems you are on JDK 6. On Sat, Jun 11, 2016 at 11:43 AM, TTS2沉默天使 <85546...@qq.com> wrote: > [INFO] --- exec-maven-plugin:1.4.0:exec (build_cube_with_engine) @ > kylin-it --- > Exception in thread "main" java.lang.UnsupportedClassVersionError: >

Re: kylin query get empty result

2016-06-13 Thread Li Yang
I tried to reproduce this problem but I cannot. If you are using 1.5.2, there is a diagnosis tool which can extract more logs that allows people at remote to help. On Wed, Jun 8, 2016 at 10:33 AM, zhangrongkun <563364...@qq.com> wrote: >

Re: Re: Timeout visiting cube!

2016-06-13 Thread Li Yang
kage。 > > What may be the problem? > > > > gaolv123...@163.com > > 发件人: Li Yang > 发送时间: 2016-06-08 17:24 > 收件人: dev > 抄送: 吴钰彬 > 主题: Re: 答复: Timeout visiting cube! > There must be something wrong during cube build. If you are using 1.5.2, > there is a diagnosis t

Re: kylin.war not deployed correctly with version 1.5

2016-06-13 Thread Li Yang
; INFORMATION: Starting service Catalina > >>> Jun 10, 2016 2:50:36 PM org.apache.catalina.core.StandardEngine > >>> startInternal > >>> INFORMATION: Starting Servlet Engine: Apache Tomcat/7.0.59 > >>> Jun 10, 2016 2:50:36 PM org.apache.catalina.start

Re: kylin.war not deployed correctly with version 1.5

2016-06-06 Thread Li Yang
The log is not related. What's in the kylin.out? On Mon, May 30, 2016 at 10:09 PM, Jie Tao wrote: > after starting Kylin this URL (http://localhost:7070/kylin/) keeps > connecting to local host but shows nothing. This happened with 1.5.0, 1.5.1 > and 1.5.2. In

Re: 答复: how to extend the threshold for kylin query?(from baixing.com)

2016-06-06 Thread Li Yang
Hi Austin, Note the image didn't get through mail list, thus was not displayed. So we didn't quite get you issue yet. Could you try describe again? You can use file hosting service to communicate attachments. Also it's always better to adopt the latest version. If you are early in pilot stage,

Re: RE: RE: RE: kylin question

2016-05-31 Thread Li Yang
水,could you give more details on the CDH version and correct Jackson version? Others can benefit from your work. On Mon, May 23, 2016 at 9:29 AM, 水。。。海 <549066...@qq.com> wrote: > I solve the exception, I replace the jackson* jars in the HBase > > > > > -- Original

Re: kylin intermediate tables in Hive

2016-06-17 Thread Li Yang
Woo... something new to me. Anybody knows? On Tue, Jun 14, 2016 at 6:57 PM, Jie Tao wrote: > Kylin actually drops useless intermediate tables after cube building, but > I still see one "kylin_intermediate_cubename_searchdata" table for each > cube building in Hive. Are

Re: Cube build error - file kylin_job_meta does not exist

2016-01-19 Thread Li Yang
, @liyang is our usage of hadoop distributed cache typical? it's not > easy to find documentations for it, is it a stable and sustainable function > of hadoop? > > On Tue, Jan 12, 2016 at 6:50 PM, Li Yang <liy...@apache.org> wrote: > > > Seems your hadoop has a problem when

Re: Re: encouter Deserialization error when load hive table

2016-01-18 Thread Li Yang
Kylin 2.0-rc still requires hbase 0.9x, it does not work with HBase 1.x. That likely be the problem. On Tue, Jan 12, 2016 at 5:55 PM, wangxianbin1...@gmail.com < wangxianbin1...@gmail.com> wrote: > HDP2.3.2, kylin 2.0-rc > > > > wangxianbin1...@gmail.com > > From: Li

Re: can we support adding mapping cube columns to hive table columns

2016-01-18 Thread Li Yang
Valid request. Creating new JIRA KYLIN-1332 . On Tue, Jan 12, 2016 at 5:17 PM, yu feng wrote: > My suggestion is adding this mapping by creating view, So, you can change > the column name in hive table, and recreate the

Re: Timeout visiting cube

2016-06-26 Thread Li Yang
select count(distinct xxx) from Query like this returns only one row, and only put very little pressure to hbase. It could take some time to calculate if the data set is huge, but shall never bring down hbase. I cannot reproduce the problem on sample cube. May find a bigger cube and try

Re: flush map output at step Build Base Cuboid Data

2016-06-26 Thread Li Yang
Don't have similar experience. If you have access to Hadoop node, maybe jstack debug the hanging process? On Mon, Jun 20, 2016 at 9:58 PM, Jie Tao wrote: > another guess: the two mappers need communication? I saw that both mappers > have a progress of 0.667 and then not

Re: update hbase coprocessor

2016-06-26 Thread Li Yang
Thanks for sharing the root cause. :-) On Fri, Jun 24, 2016 at 11:35 AM, 移动苏州研发中心-陈雷雷 <775620...@qq.com> wrote: > ignore this question, problem solved. reason: hbase - nproc in > /etc/security/limits.d/hbase.conf is too small. > > > > > -- 原始邮件 -- > 发件人:

Re: HBase Region Replication.

2016-06-26 Thread Li Yang
Sure, please open a JIRA to track the task. Contribution in this area is very appreciated. On Wed, Jun 22, 2016 at 7:11 PM, Joel Victor wrote: > Hi, > > HDP 2.2 offers "HBase Read HA" functionality. More details about this > are here[1]. > Currently in Kylin when the

Re: java.lang.NegativeArraySizeException

2016-06-26 Thread Li Yang
Kylin version? On Fri, Jun 24, 2016 at 2:01 PM, 倪成伟 <549066...@qq.com> wrote: > When I run cube to #3 Step Name: Build Dimension Dictionary ,I got the > following exceptions . > How to solve the exceptions? > > > java.lang.NegativeArraySizeException > at > >

Re: A error at cube build. @ #3 Step Name: Build Dimension Dictionary Duration: 0.03 mins

2016-06-26 Thread Li Yang
Limited effort on 1.3 branch at moment. Could you try 1.5? On Fri, Jun 24, 2016 at 2:58 PM, 倪成伟 <549066...@qq.com> wrote: > Did you solve this problem? > > -- > View this message in context: >

Re: about code formatting (KYLIN-1821)

2016-06-27 Thread Li Yang
Thanks Hongbin! Well done! We hold high bar about code quality and with tools to enforce it. On Sat, Jun 25, 2016 at 8:51 PM, hongbin ma wrote: > Hi guys > > The code reformat is done for all of the JAVA files. > > In order to make sure everyone is committing well

[VOTE] Release apache-kylin-2.0-alpha (release candidate 1)

2016-02-09 Thread Li Yang
Hi all, I have created a build for Apache Kylin 2.0-alpha, release candidate 1. It is alpha due to the big amount of new features and improvements accumulated and I want to be cautious. Yet still it is well tested. Cubes (hundreds of TB) have been rebuilt and compared with previous version to

Re: [VOTE] Release apache-kylin-2.0-alpha (release candidate 1)

2016-02-09 Thread Li Yang
ther one later. > > Thanks. > > > > > > Best Regards! > - > > Luke Han > > On Tue, Feb 9, 2016 at 11:03 PM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > +1 binding > > > > I checked the md5 hash, and verified the source

[RESULT][VOTE] Release apache-kylin-2.0-alpha (release candidate 1)

2016-02-09 Thread Li Yang
This candidate is cancelled due to two potential show stoppers in the web frontend. https://issues.apache.org/jira/browse/KYLIN-1413 https://issues.apache.org/jira/browse/KYLIN-1414 Yang

Re: re-use Hive and Hbase from another kylin cluster issue

2016-02-09 Thread Li Yang
Some big metadata (like dictionary) does not fit in HBase and in that case is stored in HDFS as a fallback. Might be something you want to check. Anyway, checkout the kylin.log is always the first step of troubleshooting. On Tue, Feb 9, 2016 at 4:14 PM, hongbin ma wrote:

[DISCUSS]Apache Kylin 2.0 Release Features & Criteria

2016-01-31 Thread Li Yang
Just to add more colors. The 2.0 rc1 has been stabilizing in the 2.0-rc branch for a few month. The 2.0 rc1 contains: - A plugin-able architecture, to allow alternative cube engine / storage engine / data source. - A better MR cubing algorithm, about 1.5 times faster than 1.x by comparing

Re: Consider submitting a talk to hbasecon2016

2016-01-29 Thread Li Yang
In the coming 2.x release, we started to do parallel scans with endpoint coprocessor. This benefits slow queries significantly compare to the 1.x observer coprocessor. Something we can share with others. On Saturday, January 30, 2016, Luke Han wrote: > Thank you to let our

Re: Hot swapping cube post build

2016-01-29 Thread Li Yang
Assuming the cube definition does not change, all you need is "refresh" an existing cube segment. The old cube segment will continue serving until the new build is complete. No down time during the whole process. Try "refresh" On Friday, January 29, 2016, hongbin ma

Re: Look for definitive books

2016-02-25 Thread Li Yang
Thanks for your interest XiangYun. There's no Kylin book at the moment. Your interest is a strong encouragement. We shall work on a book at some point of time. On Thu, Feb 25, 2016 at 4:39 PM, Xiang Yun RZ Zheng wrote: > > > Hi, > I am very interested in an amazing software

Re: Support for Hive on Tez or Hive on Spark, cube build automation and best practices

2016-01-21 Thread Li Yang
In principal, Kylin does not do any scheduling stuff. Because only upstream ETL knows when the data lands in hive. That's why Kylin provides Rest API for upstream to call when data is ready. On Sat, Jan 16, 2016 at 8:18 PM, hongbin ma wrote: > ​kylin invokes shell to

Re: kylin job压缩支持的参数!

2016-01-21 Thread Li Yang
http://kylin.apache.org/docs/install/advance_settings.html Here you find settings about compression. On Tue, Jan 19, 2016 at 8:33 PM, hongbin ma wrote: > ​you can comment out all entries containing snappy in kylin_hive_conf.xml, > kylin_job_conf.xml and kylin.properties

Re: Kylin service crash easily while building cube in HDP sandbox

2016-01-21 Thread Li Yang
What's the HDP version? Kylin 1.2 only works with HDP 2.2.4. Make sure you are NOT running on latest HDP 2.3 On Tue, Jan 19, 2016 at 1:34 PM, 宋轶 wrote: > I remember we can config the service to be a job engine or a query engine. > > > From: mahong...@apache.org > > Date:

Re: Where review for patches should happen: Github Pull Requests or Reviewboard?

2016-01-20 Thread Li Yang
We prefer patch as stated in the "How to contribute" [1]. Still evaluating the review board tool. I think it's optional. Not all commits require such heavy review process. [1] http://kylin.apache.org/development/howto_contribute.html On Thu, Jan 14, 2016 at 10:46 AM, hongbin ma

Re: Re: Using apache reviewboard for reviewing patches

2016-01-20 Thread Li Yang
I see patch files and PR basically the same thing. Personally prefer patch file, but PR is fine too. On Thu, Jan 14, 2016 at 4:48 PM, hongbin ma wrote: > good point > > in this case we should think about trying out both review ways, and pick > whichever suits us:) > > On

Re: Do we have document for 2.x-staging?

2016-02-16 Thread Li Yang
Documents now maintained in the "document" branch. The "How to Document" describes this. http://kylin.apache.org/development/howto_docs.html On Tue, Feb 16, 2016 at 3:09 PM, Zhao, John wrote: > I can find documents in master branch under website/_dev/. > But there is

Re: kylin error in building cube step 12

2016-02-18 Thread Li Yang
So you use the binary package from http://kylin.apache.org/download/ ? - apache-kylin-1.3-HBase-1.1-SNAPSHOT-bin.tar.gz According to the source code:

Re: How to use kylin with high cardinality dimensions.

2016-02-18 Thread Li Yang
user can increase the value > while query count(distinct) value. > > anything will be pleased If you have some suggestion. > > 2016-02-18 14:58 GMT+08:00 Li Yang <liy...@apache.org>: > > > Better support of UHC (ultra high cardinality) columns is on dev plan. > I'm

Re: how to format ScientificNotation(BigDecimal)

2016-02-22 Thread Li Yang
Check out calcite's SQL reference[1]. That's the SQL interface of Kylin. There you find all the supported SQL functions, like CEIL() and Anything beyond that, consider do the formatting in your own GUI tier. [1] http://calcite.apache.org/docs/reference.html On Mon, Feb 22, 2016 at 4:00 PM,

Back to one dev branch

2016-03-09 Thread Li Yang
Hi all With the settling of 1.3.0 release, the development of 1.x-staging will come to a maintenance mode. New features have been and will go on in 2.x-staging, which is the main dev branch. So I'd like to take this chance to go back to a more common branch setup -- *let master be the main dev

[RESULT][VOTE] Release apache-kylin-1.5.0 (release candidate 1)

2016-03-15 Thread Li Yang
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 6 binding +1s: 4 non-binding +1s: No 0s or -1s. Therefore I am delighted to announce that the proposal to release Apache-Kylin-1.5.0 has passed. Yang

Re: ClassNotFoundException in apache-kylin-1.5.0

2016-03-15 Thread Li Yang
UpdateCubeInfoAfterIndex I cannot find this class in v1.5.0 source code, neither in v1.3.0 On Mon, Mar 14, 2016 at 2:20 PM, hongbin ma wrote: > what is the current version you're using? > > 1.5.0 is not release yet, and the metadata migration tool for 1.2.x => > 1.5.0

Re: [VOTE] Release apache-kylin-1.3.0 (release candidate 2)

2016-03-09 Thread Li Yang
+1 binding `mvn test` passed on java version "1.7.0_79", OpenJDK Runtime Environment (rhel-2.5.5.1.el6_6-x86_64 u79-b14) On Thu, Mar 10, 2016 at 11:19 AM, nichunen wrote: > +1(no binding) > build success > mvn test passed > > md5 verified > > > > George/倪春恩 > >

[VOTE] Release apache-kylin-1.5.0 (release candidate 1)

2016-03-12 Thread Li Yang
Hi all, I have created a build for Apache Kylin 1.5.0, release candidate 1. It is the first release from the master branch after the reorg. Significant changes have taken place in metadata and cube data, upgrade from v1.3 and before is difficult. Recommend build new cube from scratch with this

[ANNOUNCE] Apache Kylin 1.5.0 released

2016-03-18 Thread Li Yang
The Apache Kylin team is pleased to announce the immediate availability of the 1.5.0 release. The release note can be found here [1]; The source code and binary package can be downloaded from Kylin's download page [2]. The Apache Kylin Team would like to hear from you and welcomes your comments

Re: Empty result return in the Insight

2016-04-08 Thread Li Yang
Don't think 1.3 and 1.5 has any difference regarding loading data from hive. Anyway, glad 1.3 has worked. On Thu, Apr 7, 2016 at 1:07 PM, kevinchen wrote: > I checked as you said, the hive return data. > Rollback to 1.3, it works. > > -- > View this message in context: >

Re: Unusable cube with large measures

2016-04-08 Thread Li Yang
Pls try latest version 1.5.1 (voting now) or 1.3.0 armed with calcite 1.6.0. Suppose the bug has been fixed in calcite 1.6.0 On Wed, Apr 6, 2016 at 4:41 AM, vipul jhawar wrote: > Hi Zhong, Luke > > I wanted to bring your attention to >

Re: Sample cube giving error on step 2

2016-04-08 Thread Li Yang
The latest version 1.5.1 under voting will have a package for HBase 1.x. Stay tuned and give it a try. On Wed, Apr 6, 2016 at 8:38 PM, Yagyank Chadha wrote: > Hi, > > I am trying to run sample cube 2 but is stuck on step 2. My problem is same > as given here( > >

Re: RANK/DENSE_RANK on KYLIN

2016-04-09 Thread Li Yang
Isn't it the same as below? SELECT CST_KEY, AMT FROM FCT ORDER BY AMT DESC On Fri, Apr 8, 2016 at 11:29 AM, hongbin ma wrote: > it's not working for kylin > > On Thu, Apr 7, 2016 at 12:51 AM, sdangi wrote: > > > Does Kylin support these analytic

Re: RANK/DENSE_RANK on KYLIN

2016-04-09 Thread Li Yang
Sorry forget the group by and sum().. SELECT CST_KEY, sum(AMT) FROM FCT group by CST_KEY ORDER BY 2 DESC On Sat, Apr 9, 2016 at 2:16 PM, Li Yang <liy...@apache.org> wrote: > Isn't it the same as below? > > SELECT CST_KEY, AMT > FROM FCT > ORDER BY AMT DESC > > On F

Re: [VOTE] Release apache-kylin-1.5.1 (release candidate 1)

2016-04-09 Thread Li Yang
+1 binding mvn test pass java version "1.7.0_71" OpenJDK Runtime Environment (rhel-2.5.3.1.el6-x86_64 u71-b14) OpenJDK 64-Bit Server VM (build 24.65-b04, mixed mode) On Fri, Apr 8, 2016 at 2:43 PM, Dong Li wrote: > Hi all, > > > I have created a build for Apache Kylin

Re: Failed to find metadata store by url: kylin_metadata@hbase

2016-03-26 Thread Li Yang
> Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.Get.setCheckExistenceOnly(Z)V Are you sure HBase version is 0.99.0? According to the source code, the method is there.

Re: [VOTE] Release apache-kylin-1.3 (release candidate 1)

2016-03-07 Thread Li Yang
-1 binding `mvn test ` fail on CentOS 6.6, java version "1.7.0_79", OpenJDK Runtime Environment (rhel-2.5.5.1.el6_6-x86_64 u79-b14). Same error as Shaofeng mentioned. On Tue, Mar 8, 2016 at 1:22 PM, ShaoFeng Shi wrote: > -1 binding > > Verified the signature, md5

Re: Kylin jdbc pool

2016-03-07 Thread Li Yang
Haven't tried Spring jdbc pool with Kylin. You might be the first to hit the problem. Mind provide more details on the error? On Mon, Mar 7, 2016 at 11:07 AM, 王琳 wrote: > Dear > > > I have a very urgent question about Kylin jdbc pool problems to > consult: > >

Re: java.lang.IllegalStateException: No resource found at

2016-03-06 Thread Li Yang
Looks like metadata is corrupted. Somewhere ref to the cube desc json, but it's not actually there. First time see this. On Sun, Mar 6, 2016 at 11:59 AM, sdangi wrote: > Hi, > > I have run too many jobs successfully but never hit any issues before on > the > 2nd step. Not

Re: Adding Oracle functions to Kylin

2016-03-01 Thread Li Yang
Many thanks Julian! Anyone wants to contribute to Calcite? Now is good opportunity! On Tue, Mar 1, 2016 at 7:38 AM, Julian Hyde wrote: > What SQL functions are missing from Kylin? I ask because there is a JIRA > case in Calcite to add a collection of Oracle-compatible

Re: update hbase data realtime and query it

2016-04-04 Thread Li Yang
Realtime support is on Kylin's roadmap. We can collaborate on this if you are interested. The idea is simple. Say current Kylin can do 5 minutes micro batch, then only need a realtime storage to catch up-to 5 minutes latest data (which comes after the last batch). Query will hit both realtime

Re: Kylin Admin console not working

2016-04-04 Thread Li Yang
Better attach the full kylin.log file if it is not clear where went wrong. This small piece is not helpful. On Fri, Apr 1, 2016 at 10:51 PM, yagyank wrote: > I have seen the log file but can't find anything abnormal. Below is the log > file. > > `2016-04-01 20:33:59,776 INFO

Re: VER1.5 -- Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]

2016-03-30 Thread Li Yang
The column under "rowkey" section should be "TXN_BOOK_DT_KEY" instead of "DT_KEY". If the cube is created through GUI then pls report a JIRA. Btw this bug has been fixed in earlier version. It come back again?! On Tue, Mar 29, 2016 at 11:21 AM, ShaoFeng Shi wrote: >

Re: install kylin 1.5 !

2016-03-29 Thread Li Yang
There should be another exception about HBaseResourceStore earlier in the log. Identify that and you shall get more clues. Suspect something wrong connecting to HBase. On Mon, Mar 28, 2016 at 9:50 AM, wenye...@163.com wrote: > I use hdp install kylin 1.5 version, installation

Re: 答复: 答复: Empty result return in the Insight query kylin1.5.1

2016-04-29 Thread Li Yang
on: Call From ip-10-21-14-62/10.21.14.62 to > 0.0.0.0:10020 failed on connection exception: java.net.ConnectException: > Connection refused; For more details see: > http://wiki.apache.org/hadoop/ConnectionRefused > > Best regards, > > Tao Li > > > -邮件原件- > 发件人: L

Re: how to get the rate value

2016-04-27 Thread Li Yang
Please provide the Kylin version in the JIRA. On Wed, Apr 27, 2016 at 1:04 PM, ShaoFeng Shi wrote: > hi dong, could you please open a JIRA to Kylin for tracking this issue? > https://issues.apache.org/jira/secure/Dashboard.jspa > > Thanks! > > 2016-04-26 20:56 GMT+08:00

Re: 答复: Empty result return in the Insight query kylin1.5.1

2016-04-27 Thread Li Yang
> the cube size is zero Then there must be something wrong during your cube build. Do you still have the kylin.log from the build start to end? On Wed, Apr 27, 2016 at 2:23 PM, Tao Li(Internship) wrote: > Hi, > I checked the kylin log: Table >

Re: Many2many relationships

2016-05-19 Thread Li Yang
Thanks, the example helps a lot. Kylin itself does not provide special feature about the many2many relationships as described in the article. Actually the classic workarounds mentioned in the article are good ones and work for Kylin too. In addition, you may make a view of user-join-sport, and

Re: 答复: kylin query failed

2016-05-19 Thread Li Yang
dar/95bd13bd-4283-4acc-8335-22e94481b1f8.snapshot > > 2016-05-17 10:15:08,057 INFO [pool-6-thread-1] > v2.CubeHBaseEndpointRPC:320 : Endpoint > RPC returned from HTable KYLIN_F6NPB6IA0Z Shard > \x4B\x59\x4C\x49\x4E\x5F\x46\x36\x4E\x50\x42\x36\x49\x41\x30\x5A\x2C\x00\x01\x2C\x31\x34\

Improve streaming cubing

2016-05-23 Thread Li Yang
Hi, I created a new JIRA to improve the current streaming cubing, to make it more scalable and resilient. Ideas and thoughts are very welcome. KYLIN-1726 Scalable streaming cubing Cheers Yang

Re: expansion rate so high

2016-05-21 Thread Li Yang
Fixed length encoding is the least efficient encoding and a cause of the high expansion. Consider use dictionary, or some custom encoding. On Wed, May 18, 2016 at 12:16 PM, hongbin ma wrote: > I guess there is one or more dimensions with very high cardinality? have > you

Re: Raw comparators

2016-05-21 Thread Li Yang
Yes, Kylin uses RawComparator to speed up MR. https://hadoop.apache.org/docs/stable/api/org/apache/hadoop/io/RawComparator.html On Thu, May 19, 2016 at 2:15 PM, Sarnath K wrote: > Hi, > Does kylin use Raw comparators while building cubes? This can speed up cube > building

Re: Partition date column

2016-05-21 Thread Li Yang
'MMdd' or > -MM-dd. > > > > > > > > -- 原始邮件 -- > 发件人: "Li Yang";<liy...@apache.org>; > 发送时间: 2016年5月19日(星期四) 下午4:49 > 收件人: "dev"<dev@kylin.apache.org>; > > 主题: Re: Partition date column

Re: too little reduce

2016-05-21 Thread Li Yang
Try again on the coming 1.5.2 release. On Fri, May 20, 2016 at 4:31 PM, 耳东 <775620...@qq.com> wrote: > I set kylin.hbase.hfile.size.gb in kylin.properties to 1 and rebuild the > cube. however in the Kylin_HFile_Generator_http_service_cube_Step, it still > submitted 3260 map with 3 reduce. > > >

Re: A error at cube build. @ #3 Step Name: Build Dimension Dictionary Duration: 0.03 mins

2016-05-21 Thread Li Yang
20:43 GMT+08:00 Li Yang <liy...@apache.org>: > > > What's the kylin version? > > > > On Fri, May 13, 2016 at 4:30 PM, 陈佛林 <chenfo...@gmail.com> wrote: > > > > > java.lang.NegativeArraySizeException > > > at > > > >

Re: Resource occupancy is low

2016-05-21 Thread Li Yang
The layered cubing does not make heavy use of memory. The fast cubing in Kylin 1.5 does leverages memory, but it does not guarantee build becomes faster. Tuning build speed is not simple task. On Thu, May 19, 2016 at 4:25 PM, 耳东 <775620...@qq.com> wrote: > hi all: > Now I am building

Re: RE: RE: RE: kylin question

2016-05-21 Thread Li Yang
The coming 1.5.2 release will provide a binary package for CDH. Apart from the issue above, especially the HBase API in CDH is not compatible with standard Hadoop. On Fri, May 20, 2016 at 5:04 PM, 水。。。海 <549066...@qq.com> wrote: > I use CDH , when I build cubes, execute job I get this exception

Re: Build Dimension Dictionary step exception : Value not exists!

2016-05-21 Thread Li Yang
Your lookup table was changed during the cube build? On Wed, May 18, 2016 at 4:15 PM, Peng wrote: > Hi, > >I have a problem at build dimension dictionary , and the exception > appears both build and refresh! > > > > ERROR [pool-5-thread-10]

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 1)

2016-05-20 Thread Li Yang
+1 mvn test pass java version "1.7.0_79" OpenJDK Runtime Environment (rhel-2.5.5.1.el6_6-x86_64 u79-b14) OpenJDK 64-Bit Server VM (build 24.79-b02, mixed mode) On Fri, May 20, 2016 at 5:37 PM, Dong Li wrote: > Hi all, > > I have created a build for Apache Kylin 1.5.2,

Re: My cube build successfully,but when query return empty data set

2016-05-15 Thread Li Yang
Kylin is meant for OLAP, it does no remember raw records. Try "select count(*) from ... " On Tue, May 10, 2016 at 5:26 PM, zhangrongkun <563364...@qq.com> wrote: > My HBase table is't empty: > < > http://apache-kylin.74782.x6.nabble.com/file/n4484/QQ%E6%88%AA%E5%9B%BE20160510173749.png > > > >

Re: The monitor web page cannot load jobs

2016-05-15 Thread Li Yang
Try refresh kylin metadata from "Admin" tab, or restart Kylin. If the problem persists and you can reproduce stably, open a JIRA. On Sat, May 14, 2016 at 11:37 AM, jyzheng wrote: > > > The version of Kylin is 1.5.0, and Hbase’s version is 0.98. > > > > After submit the

Re: A error at cube build. @ #3 Step Name: Build Dimension Dictionary Duration: 0.03 mins

2016-05-15 Thread Li Yang
What's the kylin version? On Fri, May 13, 2016 at 4:30 PM, 陈佛林 wrote: > java.lang.NegativeArraySizeException > at > org.apache.kylin.dict.TrieDictionary.getValueFromIdImpl(TrieDictionary.java:266) > at >

Re: Many2many relationships

2016-05-15 Thread Li Yang
Maybe give an example? On Fri, May 13, 2016 at 11:10 PM, Sarnath K wrote: > Hi, > > Can some1 point me how Kylin handles many2many relationships that > frequently occurs in warehouses? Is there Anything special need to be done? > Especially the queries using bridge tablez

Re: killed by admin

2016-05-15 Thread Li Yang
At least the hadoop job history server should have some traces. On Tue, May 10, 2016 at 11:13 AM, 耳东 <775620...@qq.com> wrote: > Hi all: > > When I build the cube, in the second step 'Extract Fact Table > Distinct Columns', the log shows 'killed by admin'. > And I could not find any

  1   2   3   4   5   >