Re: org.apache.hadoop.hive.ql.metadata.HiveException

2016-01-04 Thread ShaoFeng Shi
ttp://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: org.apache.hadoop.hive.ql.metadata.HiveException

2016-01-04 Thread ShaoFeng Shi
ache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) > ... 6 more > Caused by: java.lang.ClassNotFoundException: > org.apache.hive.hcatalog.mapreduce.HCatInputFormat > at > org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720) > at > org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571) > > > > > > > > -- 原始邮件 -- > 发件人: "hongbin ma";<mahong...@apache.org>; > 发送时间: 2016年1月5日(星期二) 下午2:34 > 收件人: "dev"<dev@kylin.apache.org>; > > 主题: Re: org.apache.hadoop.hive.ql.metadata.HiveException > > > > can't see attachment. please provide detailed log > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: error when insert data @@@@@create new cube

2015-12-31 Thread ShaoFeng Shi
* > The information in this email is confidential and may be legally > privileged. If you have received this email in error or are not the > intended recipient, please immediately notify the sender and delete this > message from your computer. Any use, distribution, or copying of this email > other than by the intended recipient is strictly prohibited. All messages > sent to and from us may be monitored to ensure compliance with internal > policies and to protect our business. > Emails are not secure and cannot be guaranteed to be error free as they > can be intercepted, amended, lost or destroyed, or contain viruses. Anyone > who communicates with us by email is taken to accept these risks. > > 收发邮件者请注意: > 本邮件含保密信息,若误收本邮件,请务必通知发送人并直接删去,不得使用、传播或复制本邮件。 > 进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。 > > > -- Best regards, Shaofeng Shi

Re: Select * not returning any rows

2015-12-31 Thread ShaoFeng Shi
should I backup > and > > >restore the data also in some way? > > > > > >Thank you for the immediate response. :) > > >On Dec 31, 2015 3:25 PM, "hongbin ma" <mahong...@apache.org> wrote: > > > > > >> ​i believe this issue has been fixed in v1.2, why not use the latest > > >> version? > > >> > > >> > > >> -- > > >> Regards, > > >> > > >> *Bin Mahone | 马洪宾* > > >> Apache Kylin: http://kylin.io > > >> Github: https://github.com/binmahone > > >> > > > > > -- Best regards, Shaofeng Shi

Re: org.apache.hadoop.hive.ql.metadata.HiveException

2016-01-05 Thread ShaoFeng Shi
DOObjectNotFoundException > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.jav

Re: Kyle Upgrde

2016-01-07 Thread ShaoFeng Shi
/docs/howto/howto_backup_metadata.html > > Any help in this will be much appreciated. > > Thanks, > Pavan -- Best regards, Shaofeng Shi

Re: derived dimension

2016-01-07 Thread ShaoFeng Shi
n_sales_cube" as the example to > > discuss it. There are two derived dimensions: CAL_DT and CATEGORY. > > In CAL_DT, which column derives WEEK_BEG_DT? > > In CATEGORY, which column derives > > "USER_DEFINED_FIELD1","USER_DEFINED_FIELD3","UPD_DATE","UPD_USER"? > > > > Is derived dimension used only in lookup table? > > > > [1] > > http://www.slideshare.net/YangLi43/design-cube-in-apache-kylin?next_sl > > ideshow=5 > > [2] > > https://mail-archives.apache.org/mod_mbox/incubator-kylin-dev/201507.m > > box/%3c82073af5-ae07-4441-bfdf-e8b9d36ff...@163.com%3E > > > > Best regards, > > Zhong > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Kyle Upgrde

2016-01-07 Thread ShaoFeng Shi
The page has been updated, please check: https://kylin.apache.org/docs/howto/howto_upgrade.html 2016-01-08 9:28 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > Yes we need update the "howto_upgrade" document to include the new > versions; Will update that today or tomo

Re: derived dimension

2016-01-07 Thread ShaoFeng Shi
be included in the cube. > What about the foreign keys? > > Have a wonderful day! > > Best regards, > Zhong > > On Thu, Jan 7, 2016 at 9:19 PM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > ok, for your question: > > > > Firstly, yes derived co

Re: Welcome new Apache Kylin committer: Yu Feng

2016-01-08 Thread ShaoFeng Shi
patches for bug fixes and > contributing > > a > > > great > > > feature about multi-hive source from different cluster. > > > > > > Please join me to welcome Yu. > > > > > > @Yu, please share with us a little about yourself. > > > > > > Luke Han > > > > > > On behalf of the Apache Kylin PPMC > > > > > > > > > > > -- > > Thanks, > > Dong > > > -- Best regards, Shaofeng Shi

Re: build a cube with two ultra high cardinality columns

2016-01-08 Thread ShaoFeng Shi
r cube. Both of them are > > over 50 million cardinality. When building the cube, it keeps giving us > the > > error: Error: GC overhead limit exceeded for the reduce jobs at the > > step Extract > > Fact Table Distinct Columns. > > > > We've just updated to version1.2. > > > > Can anyone give some ideas to solve this issue? > > > > Best regards, > > Zhong > > > -- Best regards, Shaofeng Shi

[RESULT] [VOTE] Release apache-kylin-1.2

2015-12-20 Thread ShaoFeng Shi
This vote passes with 6 +1s and no 0 or -1 votes: +1 Shaofeng Shi (binding) +1 Jason Zhong (binding) +1 Luke Han (binding) +1 Hua Huang (binding) +1 Xiaoyu Wang (binding) +1 Dong Li (non-binding) Thanks everyone. We’ll now roll the release out to the mirrors. Shaofeng Shi, on behalf of Apache

Re: Lzo problem

2015-12-25 Thread ShaoFeng Shi
ntain viruses. Anyone > who communicates with us by email is taken to accept these risks. > > 收发邮件者请注意: > 本邮件含保密信息,若误收本邮件,请务必通知发送人并直接删去,不得使用、传播或复制本邮件。 > 进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。 > > > -- Best regards, Shaofeng Shi

Re: Welcome new Apache Kylin committer: Luwei Chen

2015-12-30 Thread ShaoFeng Shi
gt; On behalf of the Apache Kylin PPMC > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Kylin Board Report - Jan 2016

2016-01-10 Thread ShaoFeng Shi
lished their use case at InfoQ > > > > > > > > ## Community: > > > > = > > > > - 3 committers and 0 PMC members appointed after last report. > > > > - Messages on the dev mailing list after last report: 556 > > > > - Messages on the user mailing list after last report: 118 > > > > - 109 JIRA tickets created after last report > > > > - 120 JIRA tickets closed/resolved after last report > > > > > > > > ## Releases: > > > > > > > > - The last release was v1.2 on Dec 15, 2015 > > > > > > > > > -- Best regards, Shaofeng Shi

Re: [Draft][REPORT] Apache Kylin - Jun 2016

2016-06-04 Thread ShaoFeng Shi
P) on > > Hadoop supporting extremely large datasets. > > > > ## Issues: > > == > > - there are no issues requiring board attention at this time > > > > ## Activity: > > ==== > > - Mailing list, JIRA, and commit activity are at or abov

Re: [Announce] Apache Kylin 1.5.2.1 released

2016-06-08 Thread ShaoFeng Shi
m. > > Readers should not have to click the link to find out the basic information > (although of course it is useful to have such links for further detail). > > Please can you add that information to future announce mails? > > Thanks. > > > On 8 June 2016 at 03:09, ShaoF

Re: question to building cube from kafka

2016-06-07 Thread ShaoFeng Shi
t; The question is: do your support recursive JSON structure, i.e., a JSON > attribute is an object containing other attributes? Like: > > { > "foo": { > "attr1": 70, > "att2: "blabla" > }, > "fa": > } > > Cheers, > > Jie > -- Best regards, Shaofeng Shi

[Announce] Apache Kylin 1.5.2.1 released

2016-06-07 Thread ShaoFeng Shi
and contributions. Thanks, The Apache Kylin Team [1] https://kylin.apache.org/docs15/release_notes.html [2] https://kylin.apache.org/download/ -- Best regards, Shaofeng Shi

Re: 答复: Timeout visiting cube!

2016-06-07 Thread ShaoFeng Shi
rg> > 主题: Timeout visiting cube! > > > 你好: > 每次当我build完 cube之后,都必须去更新 Update HBase Coprocessor > 否则查询的时候便会报错,如下:Error while executing SQL "SELECT * FROM > YOOSHU_BID_REQUEST_VIEWS LIMIT 10": Timeout visiting cube! > > 当执行完$KYLIN_HOME/bin/kylin.sh > org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI > $KYLIN_HOME/lib/kylin-coprocessor-*.jar all > 之后,便可以正常查询。 > 但是下次build之后,又会出现这个问题。 > > 应该如何解决的啊? > > > > > gaolv123...@163.com > -- Best regards, Shaofeng Shi

Re: question to TOP-N feature

2016-06-08 Thread ShaoFeng Shi
gt; Thanks, > > Jie > > > Am 07.06.2016 um 16:56 schrieb ShaoFeng Shi: > >> Although there is a JIRA ( >> https://issues.apache.org/jira/browse/KYLIN-1477) >> for this, I haven't found a case; Jie, would you mind to share your >> scenario? >> >> 2016-

Re: No seller_id in dimensions but can create a count distinct measure on it in kylin sample cube

2016-06-06 Thread ShaoFeng Shi
and filter by a single seller_id > > > > CDH: 5.7 > > Kylin: 1.5.2_CDH_5.7 > > > > Can anybody help me out with the confusion,thanks > > > > > > Best regards > > jxHe > > > > -- Best regards, Shaofeng Shi

[RESULT] [VOTE] Release apache-kylin-1.5.2.1 (release candidate 1)

2016-06-07 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 5 binding +1s: Shaofeng Shi Dong Li Dayue Gao Xiaoyu Wang Luke Han 1 non-binding +1s: Chunen Ni No 0s or -1s. Therefore I am delighted to announce that the proposal to release

Re: Timeout visiting cube

2016-06-12 Thread ShaoFeng Shi
ctRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:323) > at > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.execService(ClientProtos.java:32855) > at > org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1616) > ... 13 more > > > > > gaolv123...@163.com > -- Best regards, Shaofeng Shi

Re: Re: Timeout visiting cube

2016-06-12 Thread ShaoFeng Shi
a JIRA with the necessary logs, we will investigate. 2016-06-13 9:58 GMT+08:00 gaolv123...@163.com <gaolv123...@163.com>: > version infos : > > Kylin 1.5.1 > HBase 1.1.4 for apache package > hadoop cdh5.7 > > > > gaolv123...@163.com > > From: ShaoFeng Shi >

Re: How to do DateDiff in Kylin

2016-06-11 Thread ShaoFeng Shi
ut that has not > been implemented. > > Julian > > > On Fri, Jun 10, 2016 at 7:54 AM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > I don't see such a function in Calcite (Kylin's SQL parser): > > https://calcite.apache.org/docs/reference.html#da

Re: unable to start Kylin

2016-06-03 Thread ShaoFeng Shi
> *This is what I'm getting, and Kylin is not launching. Am I doing any > mistake here.. please help.* > > > > -- > > Thanks & Regards, > Veeresh Kottargi > Cell : 07299166704 / 09035503204 <%2009035503204> > Chennai-India > -- > -- Best regards, Shaofeng Shi

Re: kylin_client_tool.py

2016-05-25 Thread ShaoFeng Shi
nor that this email message is free of > viruses, interceptions, or interference. > -- Best regards, Shaofeng Shi

Re: How to do DateDiff in Kylin

2016-06-10 Thread ShaoFeng Shi
ains date) > > ____ > From: ShaoFeng Shi <shaofeng...@apache.org> > Sent: Thursday, June 9, 2016 8:22:08 PM > To: dev@kylin.apache.org > Subject: Re: How to do DateDiff in Kylin > > Hi Uma, could you please give a sample SQL with DateDiff? > > 2016-06-

Re: How to do DateDiff in Kylin

2016-06-11 Thread ShaoFeng Shi
This has been in Calcite for quite a few releases. > > > > > On Jun 11, 2016, at 3:27 AM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > > Julian, from which version Calcite supports the minus operation between > two > > dates? > > > > I t

Re: 答复: 答复: 答复: snapshot table not update

2016-06-11 Thread ShaoFeng Shi
Issue created, please subscribe it for update: https://issues.apache.org/jira/browse/KYLIN-1780 2016-06-12 11:54 GMT+08:00 yubo-...@yolo24.com <yubo-...@yolo24.com>: > Yes. All rows in the table changed > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > ml-node+s74782n491

Re: 答复: 答复: snapshot table not update

2016-06-11 Thread ShaoFeng Shi
Is the table content changed in between? 2016-06-12 10:55 GMT+08:00 yubo-...@yolo24.com <yubo-...@yolo24.com>: > I updated all the rows. > > Actually, I dropped the table and created it again. > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > ml-node+s74782n490...@n6.

[VOTE] Release apache-kylin-1.5.2.1 (release candidate 1)

2016-06-04 Thread ShaoFeng Shi
not release this package because... Here is my vote: +1 (binding) Shaofeng Shi

Re: 配置问题

2016-06-08 Thread ShaoFeng Shi
) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > 2016-06-09 00:41:05,335 INFO [Thread-1] > client.ConnectionManager$HConnectionImplementation: Closing zookeeper > sessionid=0x15530aec581000a > 2016-06-09 00:41:05,349 INFO [main-EventThread] zookeeper.ClientCnxn: > EventThread shut down > 2016-06-09 00:41:05,354 INFO [Thread-1] zookeeper.ZooKeeper: Session: > 0x15530aec581000a closed -- Best regards, Shaofeng Shi

Re: stream build problem

2016-06-08 Thread ShaoFeng Shi
I guess you're running the master branch, which is unstable; suggest to use the latest released version 1.5.2.1. For the error you reported, a JIRA is created: https://issues.apache.org/jira/browse/KYLIN-1777 Thanks; 2016-06-09 10:19 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: >

Re: Unable build sample cube.Failing at Step 2

2016-05-30 Thread ShaoFeng Shi
even there i am not abed to see any > job. > > Job is not submitting to Hadoop. > > > Can i know any solution for this > Regards, > Mahesh > -- Best regards, Shaofeng Shi

Re: question about the joint dimension and query

2016-05-26 Thread ShaoFeng Shi
llows, where should I configure? > # java.lang.OutOfMemoryError: Java heap space > # -XX:OnOutOfMemoryError="kill -9 %p" > # Executing /bin/sh -c "kill -9 1909"... -- Best regards, Shaofeng Shi

Re: Understanding the cube building process

2016-05-26 Thread ShaoFeng Shi
here any presentation, blog post, that gives and overview of > > these > > > > internals? I did find [1] but I'm looking go descend another level. > I'm > > > > curious about the various steps involved (looks like it ran 18 > "steps" > > > and > > > > 10 MR jobs), what they're doing. I'm also curious about the schema > > design > > > > for the data model in HBase. > > > > > > > > Thanks in advance! > > > > -n > > > > > > > > [0]: http://kylin.apache.org/docs15/tutorial/kylin_sample.html > > > > [1]: http://www.slideshare.net/YangLi43/design-cube-in-apache-kylin > > > > > > > > > > -- Best regards, Shaofeng Shi

Re: [ANNOUNCE] Apache Kylin 1.5.2 released

2016-05-26 Thread ShaoFeng Shi
hanks, > The Apache Kylin Team > > [1] https://kylin.apache.org/docs15/release_notes.html > [2] https://kylin.apache.org/download/ > -- Best regards, Shaofeng Shi

Re: kylin hbase 1.2.1

2016-06-15 Thread ShaoFeng Shi
l.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > 2016-06-15 17:06:42,218 INFO [Thread-1] > client.ConnectionManager$HConnectionImplementation: Closing zookeeper > sessionid=0x155534c2e010006 > 2016-06-15 17:06:42,313 INFO [Thread-1] zookeeper.ZooKeeper: Session: > 0x155534c2e010006 closed > 2016-06-15 17:06:42,329 INFO [main-EventThread] zookeeper.ClientCnxn: > EventThread shut down > -- Best regards, Shaofeng Shi

Re: GHow to query TOP-N

2016-06-13 Thread ShaoFeng Shi
yes 2016-06-14 0:40 GMT+08:00 Jie Tao <jie@gameforge.com>: > > shall I use "select sum(price) group by seller_id" for the defined measure > TOP_SELLER with sum(price) and seller_id? > > Cheers, > > Jie > -- Best regards, Shaofeng Shi

Re: 答复: Re: Timeout visiting cube!

2016-06-21 Thread ShaoFeng Shi
: 吴钰彬 > > 主题: Re: 答复: Timeout visiting cube! > > There must be something wrong during cube build. If you are using > > 1.5.2, there is a diagnosis tool that extract useful info that helps > diagnose. > > > > On Wed, Jun 8, 2016 at 10:07 AM, ShaoFeng Shi <shaofeng..

Re: Kylin failed to startup

2016-06-22 Thread ShaoFeng Shi
re.java:93) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) > at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:880) > > > is there any problem in kylin.properties setting of > kylin_metadata@hbase ? thx > > > > > > -- Best regards, Shaofeng Shi

Re: [jira] [Created] (KYLIN-1813) intermediate table in Hive not cleaned up

2016-06-22 Thread ShaoFeng Shi
gt; intermediate hive table with job id >> 8a377e30-e3ba-4fe2-be12-e7d412afec5ewith job status ERROR >> >> In this case the intermediate tables were not removed from hive (see >> hive.png). The json is also attached json.txt >> >> >> >> -- >> This message was sent by Atlassian JIRA >> (v6.3.4#6332) >> > > -- Best regards, Shaofeng Shi

Re: Extract Fact Table Distinct Columns problem

2016-06-16 Thread ShaoFeng Shi
s doing, Can do a simple function > description? > > > > In this FactDistinctColumnsJob.class , Line 80 ,List > columnsNeedDict = cubeMgr.getAllDictColumnsOnFact(cubeDesc) : The method to > realize the function of what. > > > > > > > > > > Thanks! > > > > > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
tually drops useless intermediate tables after cube building, but > > I still see one "kylin_intermediate_cubename_searchdata" table for each > > cube building in Hive. Are these tables still usefull for Kylin? I use > > Kylin 1.5.2.1. > > > > Cheers, > > > > Jie > > > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
BTW, are you using a view as lookup table? 2016-06-17 15:15 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > This is common; If you have a job failed in between, and you discard that > job, the "Garbage collection" step will not be executed, so the g

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
? > > Jie > > > Am 17.06.2016 um 10:31 schrieb ShaoFeng Shi: > >> Hi Jie, >> >> If a job is "ERROR", the intermediate hive table of it will not be >> dropped, >> as "ERROR" is not a final state; User can resume an "Error"

Re: DISTINCT_COUNT精确计算问题

2016-06-21 Thread ShaoFeng Shi
distinct xx) 函数统计好像只支持 int类型的统计. > > 希望可以帮到你. > > Roy > > > > > 在 2016-06-21 15:08:46,"仇同心" <qiutong...@jd.com> 写道: > >大家好: > > > Hive字段类型为varchar,字段内容也包含英文字母和中文,对这样的字段能否做DISTINCT_COUNT精确计算?如果不能,有什么好的建议吗? > > > >谢谢! > -- Best regards, Shaofeng Shi

Re: kylin question

2016-06-21 Thread ShaoFeng Shi
://apache-kylin.74782.x6.nabble.com/java-lang-NoSuchMethodError-org-apache-hadoop-hbase-coprocessor-RegionCoprocessorEnvironment-getRegi-tp4698p5061.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-21 Thread ShaoFeng Shi
. My Kylin is 1.5.2.1. > > Cheers, > > Jie > > > Am 17.06.2016 um 11:05 schrieb ShaoFeng Shi: > >> by default the web UI only shows the jobs in LAST ONE WEEK, pls have a >> check. >> >> 2016-06-17 16:58 GMT+08:00 Jie Tao <jie@gameforge.com>

Re: join & left join in kylin

2016-06-20 Thread ShaoFeng Shi
snowflake schema in data warehouse? > 2.If Kylin can only support star schema, under what circumstances shall > we use join instead of left join? > > > look forward to your help, thx~ > > > > > > > -- > 李寅威 | CVTE > cor...@foxmail.com > 广州视源电子科技股份有限公司 > Guangzhou Shiyuan Electronics Co., Ltd. -- Best regards, Shaofeng Shi

Re: Timeout visiting cube

2016-06-21 Thread ShaoFeng Shi
] Cuboid Ids: [1048062] Total scan > count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false > Hit Exception Cache: false Storage cache used: false > Message: Error while executing SQL "select count(distinct userid) from > cortanauu LIMIT 5": Timeout visiting cube! > ==[QUERY]=== > > > > -Original Message- > From: hongbin ma [mailto:mahong...@apache.org] > Sent: Wednesday, June 15, 2016 10:09 PM > To: dev <dev@kylin.apache.org> > Subject: Re: Timeout visiting cube > > ​actually, can you please attach latest 2 minutes' log before > 2016-06-15 02:18:22,741? > it's still incomplete for our analysis > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: > https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fkylin.io=01%7c01%7cjiaoli%40064d.mgd.microsoft.com%7ce53a04299632406e334208d395269be8%7c72f988bf86f141af91ab2d7cd011db47%7c1=vpTxGJMsJQ7CoMHsEjHWBxaRVgQWfLVp6mcuFmlqzzI%3d > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Number of cube dimensions is limited to 62?

2016-06-17 Thread ShaoFeng Shi
t regards > -- > Victoria Tskhay > > *Java Backend Developer*I glispa GmbH > > Sonnenburger Straße 73, 10437 Berlin, Germany > E victoria.tsk...@glispamedia.com e.mail.ru/compose/?mailto=mailto%3avictoria.tsk...@glispamedia.com> > Skype: vikatskhay I www.glispa.com <http://www.glispa.com> > > Sitz Berlin, AG Charlottenburg HRB 114678B > -- Best regards, Shaofeng Shi

Re: 问下怎么调试sample.sh

2016-06-20 Thread ShaoFeng Shi
ar ${job_jar} > org.apache.kylin.common.persistence.ResourceTool upload > ${KYLIN_HOME}/sample_cube/metadata > 这段我想debug查看执行过程应该怎么做? -- Best regards, Shaofeng Shi

Re: MAX aggregation for name column

2016-06-23 Thread ShaoFeng Shi
t;zhangjian...@gmail.com>1...@gmail.com > P.C. 518055 > Add: 中国广东省深圳市西丽大学城清华园H楼205 > Room 205, Building H, Tsinghua Campus, The University Town, Shenzhen, > P.R.China > 清华大学计算机科学与技术系 > Department of Computer Science and Technology, Tsinghua University > -- Best regards, Shaofeng Shi

Re: Kylin and Tableau -- Top N query

2016-01-16 Thread ShaoFeng Shi
ble? > No. It had only 1 month of data from hive tables. > c) Was the fact/lookup table data changed since cube be built? > No. > > > ShaoFeng Shi-2 wrote > > How much difference between Hive and Kylin? Did you check some factors > > like: a) any filtering condition in

Re: TopN Results Differ in Hive and Kylin

2016-01-16 Thread ShaoFeng Shi
in which way are you connecting to Kylin, ODBC, JDBC, Rest API or the web UI?

Re: beg suggestions to speed up the Kylin cube build

2016-01-14 Thread ShaoFeng Shi
ully utilize the resource? > > Looking forward to hear from you. > > Best regards, > Zhong > -- Best regards, Shaofeng Shi

Re: Kylin and Tableau -- Top N query

2016-01-14 Thread ShaoFeng Shi
MM > > The query shows different Top N records in Tableau as compared to Kylin and > Hive. > > Thanks, > Regards, > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/Kylin-and-Tableau-Top-N-query-tp3250.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: beg suggestions to speed up the Kylin cube build

2016-01-14 Thread ShaoFeng Shi
t; >> >> step ‘convert to hfile’, which is same as the region count. > >> >> > >> >> I think we could increase the number of reducers, to improve > >> performance. > >> >> If anyone has interesting in this, we could discuss more about th

Re: kylin.hdfs.working.dir becoming too large

2016-06-28 Thread ShaoFeng Shi
Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
gt; intermediate hive table with job id 8a377e30-e3ba-4fe2-be12-e7d412afec5e > with job status ERROR > > Best regards, > > Jie > > > Am 17.06.2016 um 09:16 schrieb ShaoFeng Shi: > >> BTW, are you using a view as lookup table? >> >> 2016-06-17 15:15 GMT+0

Re: StringIndexOutOfBoundsException: String index out of range: -1

2016-02-04 Thread ShaoFeng Shi
I see, thanks for reporting! 发送自 Outlook Mobile On Thu, Feb 4, 2016 at 1:36 AM -0800, <h...@uni.de> wrote: Done ;-) 2016-02-04 9:15 GMT+01:00 ShaoFeng Shi : > Hi, two would be better. > > 2016-02-04 16:10 GMT+08:00 : > >> Hi, >> >> shoul

Re: re-use Hive and Hbase from another kylin cluster issue

2016-02-07 Thread ShaoFeng Shi
what's the version of your new and old kylin? 发送自 Outlook Mobile On Sat, Feb 6, 2016 at 2:49 PM -0800, "greg gu" wrote: I originally have a kylin cluster, I deleted it without deleting the Hbase and Hive storages. now I created a new kylin cluster and would

Re: [VOTE] Release apache-kylin-2.0-alpha (release candidate 1)

2016-02-09 Thread ShaoFeng Shi
.apache.org/content/repositories/orgapachekylin-1018/ > > > > > > > >Release artifacts are signed with the following key: > > > >https://people.apache.org/keys/committer/liyang.asc > > > > > > > >Please vote on releasing this package as Apache Kylin 2.0-alpha. > > > > > > > >The vote is open for the next 72 hours and passes if a majority of at > > > >least > > > >three +1 PPMC votes are cast. > > > > > > > >[ ] +1 Release this package as Apache Kylin 1.2 > > > >[ ] 0 I don't feel strongly about it, but I'm okay with the release > > > >[ ] -1 Do not release this package because... > > > > > > > > > > > >Here is my vote: > > > > > > > >+1 (binding) > > > > > > > >-- > > > >Best regards, > > > > > > > >Yang > > > > > > > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Kylin.sandbox=true in config

2016-01-29 Thread ShaoFeng Shi
nfigure is > deploy.env=Dev|QA|prod > > what's the differences of the three values? > > Greg > > Sent from my iPhone > > > On Jan 28, 2016, at 7:06 PM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > > set Kylin.sandbox=false will start to use LDAP

Re: Kylin installation on EMR cluster

2016-01-27 Thread ShaoFeng Shi
ny manual on installing Kylin on Amazon EMR cluster? > -- Best regards, Shaofeng Shi

Re: elastic search as kylin storage engine

2016-01-27 Thread ShaoFeng Shi
icSearchTupleIterator" > ,Otherwise, excute > > "org.apache.kylin.storage.elasticsearch.SerializedElasticAggregationTupleIterator" > > the count() function is blocked before the SQLDigest,so it does not support > count() now. > > thanks! > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/elastic-search-as-kylin-storage-engine-tp3429p3470.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: How to run UT and IT in Kylin 2.0 above

2016-01-26 Thread ShaoFeng Shi
> > $KYLIN_HOME/examples/test_case_data/sandbox/kylin.properties. Try > > > appending -DfastBuildMode=true to mvn verify command to speed up > > provision > > > by skipping incremental cubing. > > > > > > *Will update the above information to our website when 2.0 is released* > > > > > > -- > > > Regards, > > > > > > *Bin Mahone | 马洪宾* > > > Apache Kylin: http://kylin.io > > > Github: https://github.com/binmahone > > > > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Exact distinct count support

2016-01-28 Thread ShaoFeng Shi
set again, but with the new cubing algo (2.x branch) should be > > simpler to add ? > > > >If currently not present are there any plans to introduce this ? > > > > Regards, > > Abhilash > > > -- Best regards, Shaofeng Shi

Re: N Cuboids preparation MapReduce - Trying to avoid multiple stage read

2016-02-01 Thread ShaoFeng Shi
ing-to-avoid-multiple-stage-read-tp3528p3531.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: StringIndexOutOfBoundsException: String index out of range: -1

2016-02-03 Thread ShaoFeng Shi
to a cubing job, it's a separate task to help > modeling. > >> can you checkout the output in /tmp/kylin/cardinality/KYLIN_DK.DIM_DTM, > it > >> seems the content format is not as expected: > >> > https://github.com/apache/kylin/blob/kylin-1.2/job/src/main/java/org/apache/kylin/job/hadoop/cardinality/HiveColumnCardinalityUpdateJob.java#L113 > >> > >> > >> > >> -- > >> Regards, > >> > >> *Bin Mahone | 马洪宾* > >> Apache Kylin: http://kylin.io > >> Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: how to bootstrap kylin example project/cube in 2.x-staging

2016-02-03 Thread ShaoFeng Shi
rted kylin server in IDE, but need run job to get example > project/cube) > > Thanks > -- Best regards, Shaofeng Shi

Re: StringIndexOutOfBoundsException: String index out of range: -1

2016-02-04 Thread ShaoFeng Shi
Hi, two would be better. 2016-02-04 16:10 GMT+08:00 <h...@uni.de>: > Hi, > > should I file one or two different Jira's (IndexOutOfBounds + Bucket > tables)? > > > 2016-02-03 15:34 GMT+01:00 ShaoFeng Shi <shaofeng...@apache.org>: > > Kylin uses HCatalog t

Re: only one reducer in job

2016-02-02 Thread ShaoFeng Shi
, which cause > the job to run very long time. > > I found this https://issues.apache.org/jira/browse/KYLIN-1066, it > mentioned the issue is fixed. > > > > If there a way to change the number of reducer? > > > > Thanks, > > > > > > > > -- Best regards, Shaofeng Shi

Re: Exact distinct count support

2016-01-28 Thread ShaoFeng Shi
/jira/browse/KYLIN-1186> is not a > mature feature yet and it only supports integer > we don't yet have plans to support any other forms of precise distinct > count, as it is too expensive to pre-calculate > > On Thu, Jan 28, 2016 at 6:56 PM, Abhilash L L <abhil...@infoworks.io>

Re: Exact distinct count support

2016-01-28 Thread ShaoFeng Shi
I removed the code for long type in BitmapCounter as the casting will get things wrong (but the target is to provide accurate value); @Yerui, for you awareness; once we find the solution for long, then add it back. 2016-01-28 22:13 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: &g

Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase 1.0

2016-02-27 Thread ShaoFeng Shi
this message in context: > http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3742.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase 1.0

2016-02-28 Thread ShaoFeng Shi
CY_DIM_ORC.CCY_KEY > WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03' > GROUP BY > CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR > ORDER BY TOT_USD_TXN_AMT DESC > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: no projects in the Kylin UI

2016-01-25 Thread ShaoFeng Shi
the late update. And thanks so much for taking time to help. Sorry once again. Best regards, Zhong B On Sun, Jan 24, 2016 at 8:47 AM, ShaoFeng Shi wrote: > I think Zhong's problem has got fixed by himself. Other guys please ignore. > > For the people ask question in mailing list: when you found

Re: internal hive table and build the cube backward

2016-01-19 Thread ShaoFeng Shi
gt; It's well known that the input of Kylin cube is hive table. Does it > make > > > any difference > > > between using internal hive table and external hive table when building > > the > > > cube? > > > > > > Best regards, > > > Zhong > > > > > > -- Best regards, Shaofeng Shi

Re: Patch Review Request for EAGLE-1363 and EAGLE-1355

2016-01-27 Thread ShaoFeng Shi
Thanks Hao! 2016-01-27 21:54 GMT+08:00 hongbin ma <mahong...@apache.org>: > merged > > thank you for your contribution Hao > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase 1.0

2016-02-29 Thread ShaoFeng Shi
NER JOIN CCY_DIM_ORC as CCY_DIM_ORC > ON TXN_FCT_ORC.RMTR_CCY_KEY = CCY_DIM_ORC.CCY_KEY > WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03' > GROUP BY > CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR > ORDER BY TOT_USD_TXN_AMT DESC > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: ClassNotFoundException in apache-kylin-1.5.0

2016-03-15 Thread ShaoFeng Shi
> > > > > http://apache-kylin.74782.x6.nabble.com/ClassNotFoundException-in-apache-kylin-1-5-0-tp3882p3888.html > > > Sent from the Apache Kylin mailing list archive at Nabble.com. > > > > > > > > > > > -- > > Regards, > > > > *Bin Mahone | 马洪宾* > > Apache Kylin: http://kylin.io > > Github: https://github.com/binmahone > > > -- Best regards, Shaofeng Shi

Re: [VOTE] Release apache-kylin-1.5.0 (release candidate 1)

2016-03-12 Thread ShaoFeng Shi
1.5.0. The vote is open for the next > 72 hours and passes if a majority of at least three +1 PPMC votes are cast. > [ ] +1 Release this package as Apache Kylin 1.5.0 [ ] 0 I don't feel > strongly about it, but I'm okay with the release [ ] -1 Do not release this > package because... Here is my vote: +1 (binding) Yang > -- Best regards, Shaofeng Shi

Re: Hive error when running kylin

2016-04-06 Thread ShaoFeng Shi
in/bin/..//logs/kylin.log > > -- > Regards > *Yagyank chadha* > > *Undergraduate student* > *Computer Science Engineering* > *Thapar University, Patiala* > -- Best regards, Shaofeng Shi

Re: Cube bulid success,insight no display table

2016-04-08 Thread ShaoFeng Shi
Best Regards > > Roy He > -- Best regards, Shaofeng Shi

Re: Re: Cube bulid success,insight no display table

2016-04-08 Thread ShaoFeng Shi
> port 7070. so we need modify some config? > > > > > > > > > At 2016-04-08 17:02:32, "ShaoFeng Shi" <shaofeng...@apache.org> wrote: > >is your kylin in a singleton mode or cluster mode? does it listen on port > >7070? > > > >2016

Re: [VOTE] Release apache-kylin-1.5.1 (release candidate 1)

2016-04-09 Thread ShaoFeng Shi
chekylin-1024 > >> > >> > >> Release artifacts are signed with the following key: > >> https://people.apache.org/keys/committer/lidong.asc > >> > >> > >> Please vote on releasing this package as Apache Kylin 1.5.1. > >> > >> > >> The vote is open for the next 72 hours and passes if a majority of > >> at least three +1 PPMC votes are cast. > >> > >> > >> [ ] +1 Release this package as Apache Kylin 1.5.1 > >> [ ] 0 I don't feel strongly about it, but I'm okay with the release > >> [ ] -1 Do not release this package because... > >> > >> > >> Here is my vote: > >> > >> > >> +1 (binding) > >> > >> > >> Thanks, > >> Dong Li > > -- Best regards, Shaofeng Shi

Re: Welcome new committer and PMC member

2016-04-11 Thread ShaoFeng Shi
>Xiaoyu Wang and Dong Li to become PMC member, and they both accepted. > > > >They have made significant contributions, patches, also activity > >answer others questions and issues in Kylin's community. > > > >Welcome:) > > > >Luke > > > >On behalf of the Apache Kylin PPMC > > -- Best regards, Shaofeng Shi

Re: 遇到该问题怎么解决

2016-04-12 Thread ShaoFeng Shi
ion.getClass(Configuration.java:2110) > ... 8 more -- Best regards, Shaofeng Shi

Re: an error occurred when build a sample cube at step 5:create HTable

2016-04-12 Thread ShaoFeng Shi
; http://apache-kylin.74782.x6.nabble.com/an-error-occurred-when-build-a-sample-cube-at-step-5-create-HTable-tp4102p4140.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: Does INMEM Cubing algorithm release in v1.3?

2016-04-06 Thread ShaoFeng Shi
" + seg + " is " + alg);) > > Is there some docs describ the inmem cubing algorithm ? Is this one ( > http://www.infoq.com/cn/articles/apache-kylin-algorithm)? > -- Best regards, Shaofeng Shi

Re: AbstractHadoopJob.java and KYLIN_HIVE_DEPENDENCY_JARS in 1.3 & 1.5 versions

2016-03-23 Thread ShaoFeng Shi
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158) > *Caused by: java.lang.ClassNotFoundException: Class > org.apache.hive.hcatalog.mapreduce.HCatInputFormat not found* > at > > org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2105) > at > org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2197) > ... 8 more > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/AbstractHadoopJob-java-and-KYLIN-HIVE-DEPENDENCY-JARS-in-1-3-1-5-versions-tp3951.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: Can we choose layered cubing or im-memory cubing manually

2016-03-26 Thread ShaoFeng Shi
> Best regards, > Yanghong Zhong > yangzh...@ebay.com > -- Best regards, Shaofeng Shi

Re: About the function of the "Refresh" button under tab "System"

2016-03-26 Thread ShaoFeng Shi
nfig" is not persisted to the configuration file. ​A brutal reload > will clear all the changes being made. > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: [VOTE] Release apache-kylin-1.3 (release candidate 1)

2016-03-07 Thread ShaoFeng Shi
is open for the next > 72 hours and passes if a majority of at least three +1 PPMC votes are cast. > [ ] +1 Release this package as Apache Kylin 1.3 [ ] 0 I don't feel strongly > about it, but I'm okay with the release [ ] -1 Do not release this package > because... Here is my vote: +1 (binding) -- Regards, *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io Github: https://github.com/binmahone -- Best regards, Shaofeng Shi

Re: multiple user in kylin

2016-03-08 Thread ShaoFeng Shi
in support multiple user besides ADMIN? > This may be useful when integrating kylin in our workflow, we may need > to > do isolation work between different users in hdfs/mr/hive/hbase. > > Thanks. > > -- > Ding Dinghua > -- Best regards, Shaofeng Shi

Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase 1.0

2016-03-03 Thread ShaoFeng Shi
egards, > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3784.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

  1   2   3   4   5   6   7   8   9   10   >