Re: org.apache.hadoop.hive.ql.metadata.HiveException

2016-01-04 Thread ShaoFeng Shi
ttp://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: error when insert data @@@@@create new cube

2015-12-31 Thread ShaoFeng Shi
* > The information in this email is confidential and may be legally > privileged. If you have received this email in error or are not the > intended recipient, please immediately notify the sender and delete this > message from your computer. Any use, distribution, or copying of this email > other than by the intended recipient is strictly prohibited. All messages > sent to and from us may be monitored to ensure compliance with internal > policies and to protect our business. > Emails are not secure and cannot be guaranteed to be error free as they > can be intercepted, amended, lost or destroyed, or contain viruses. Anyone > who communicates with us by email is taken to accept these risks. > > 收发邮件者请注意: > 本邮件含保密信息,若误收本邮件,请务必通知发送人并直接删去,不得使用、传播或复制本邮件。 > 进出邮件均受到本公司合规监控。邮件可能发生被截留、被修改、丢失、被破坏或包含计算机病毒等不安全情况。 > > > -- Best regards, Shaofeng Shi

Re: Select * not returning any rows

2015-12-31 Thread ShaoFeng Shi
should I backup > and > > >restore the data also in some way? > > > > > >Thank you for the immediate response. :) > > >On Dec 31, 2015 3:25 PM, "hongbin ma" <mahong...@apache.org> wrote: > > > > > >> ​i believe this issue has been fixed in v1.2, why not use the latest > > >> version? > > >> > > >> > > >> -- > > >> Regards, > > >> > > >> *Bin Mahone | 马洪宾* > > >> Apache Kylin: http://kylin.io > > >> Github: https://github.com/binmahone > > >> > > > > > -- Best regards, Shaofeng Shi

Re: org.apache.hadoop.hive.ql.metadata.HiveException

2016-01-05 Thread ShaoFeng Shi
DOObjectNotFoundException > at java.net.URLClassLoader$1.run(URLClassLoader.java:366) > at java.net.URLClassLoader$1.run(URLClassLoader.java:355) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.jav

Re: derived dimension

2016-01-07 Thread ShaoFeng Shi
n_sales_cube" as the example to > > discuss it. There are two derived dimensions: CAL_DT and CATEGORY. > > In CAL_DT, which column derives WEEK_BEG_DT? > > In CATEGORY, which column derives > > "USER_DEFINED_FIELD1","USER_DEFINED_FIELD3","UPD_DATE","UPD_USER"? > > > > Is derived dimension used only in lookup table? > > > > [1] > > http://www.slideshare.net/YangLi43/design-cube-in-apache-kylin?next_sl > > ideshow=5 > > [2] > > https://mail-archives.apache.org/mod_mbox/incubator-kylin-dev/201507.m > > box/%3c82073af5-ae07-4441-bfdf-e8b9d36ff...@163.com%3E > > > > Best regards, > > Zhong > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Welcome new Apache Kylin committer: Yu Feng

2016-01-08 Thread ShaoFeng Shi
patches for bug fixes and > contributing > > a > > > great > > > feature about multi-hive source from different cluster. > > > > > > Please join me to welcome Yu. > > > > > > @Yu, please share with us a little about yourself. > > > > > > Luke Han > > > > > > On behalf of the Apache Kylin PPMC > > > > > > > > > > > -- > > Thanks, > > Dong > > > -- Best regards, Shaofeng Shi

[RESULT] [VOTE] Release apache-kylin-1.2

2015-12-20 Thread ShaoFeng Shi
This vote passes with 6 +1s and no 0 or -1 votes: +1 Shaofeng Shi (binding) +1 Jason Zhong (binding) +1 Luke Han (binding) +1 Hua Huang (binding) +1 Xiaoyu Wang (binding) +1 Dong Li (non-binding) Thanks everyone. We’ll now roll the release out to the mirrors. Shaofeng Shi, on behalf of Apache

Re: Welcome new Apache Kylin committer: Luwei Chen

2015-12-30 Thread ShaoFeng Shi
gt; On behalf of the Apache Kylin PPMC > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: [Draft][REPORT] Apache Kylin - Jun 2016

2016-06-04 Thread ShaoFeng Shi
P) on > > Hadoop supporting extremely large datasets. > > > > ## Issues: > > == > > - there are no issues requiring board attention at this time > > > > ## Activity: > > ==== > > - Mailing list, JIRA, and commit activity are at or abov

Re: [Announce] Apache Kylin 1.5.2.1 released

2016-06-08 Thread ShaoFeng Shi
m. > > Readers should not have to click the link to find out the basic information > (although of course it is useful to have such links for further detail). > > Please can you add that information to future announce mails? > > Thanks. > > > On 8 June 2016 at 03:09, ShaoF

Re: question to building cube from kafka

2016-06-07 Thread ShaoFeng Shi
t; The question is: do your support recursive JSON structure, i.e., a JSON > attribute is an object containing other attributes? Like: > > { > "foo": { > "attr1": 70, > "att2: "blabla" > }, > "fa": > } > > Cheers, > > Jie > -- Best regards, Shaofeng Shi

[Announce] Apache Kylin 1.5.2.1 released

2016-06-07 Thread ShaoFeng Shi
and contributions. Thanks, The Apache Kylin Team [1] https://kylin.apache.org/docs15/release_notes.html [2] https://kylin.apache.org/download/ -- Best regards, Shaofeng Shi

Re: 答复: Timeout visiting cube!

2016-06-07 Thread ShaoFeng Shi
rg> > 主题: Timeout visiting cube! > > > 你好: > 每次当我build完 cube之后,都必须去更新 Update HBase Coprocessor > 否则查询的时候便会报错,如下:Error while executing SQL "SELECT * FROM > YOOSHU_BID_REQUEST_VIEWS LIMIT 10": Timeout visiting cube! > > 当执行完$KYLIN_HOME/bin/kylin.sh > org.apache.kylin.storage.hbase.util.DeployCoprocessorCLI > $KYLIN_HOME/lib/kylin-coprocessor-*.jar all > 之后,便可以正常查询。 > 但是下次build之后,又会出现这个问题。 > > 应该如何解决的啊? > > > > > gaolv123...@163.com > -- Best regards, Shaofeng Shi

Re: question to TOP-N feature

2016-06-08 Thread ShaoFeng Shi
gt; Thanks, > > Jie > > > Am 07.06.2016 um 16:56 schrieb ShaoFeng Shi: > >> Although there is a JIRA ( >> https://issues.apache.org/jira/browse/KYLIN-1477) >> for this, I haven't found a case; Jie, would you mind to share your >> scenario? >> >> 2016-

[RESULT] [VOTE] Release apache-kylin-1.5.2.1 (release candidate 1)

2016-06-07 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 5 binding +1s: Shaofeng Shi Dong Li Dayue Gao Xiaoyu Wang Luke Han 1 non-binding +1s: Chunen Ni No 0s or -1s. Therefore I am delighted to announce that the proposal to release

Re: Timeout visiting cube

2016-06-12 Thread ShaoFeng Shi
ctRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:323) > at > org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.execService(ClientProtos.java:32855) > at > org.apache.hadoop.hbase.protobuf.ProtobufUtil.execService(ProtobufUtil.java:1616) > ... 13 more > > > > > gaolv123...@163.com > -- Best regards, Shaofeng Shi

Re: Re: Timeout visiting cube

2016-06-12 Thread ShaoFeng Shi
a JIRA with the necessary logs, we will investigate. 2016-06-13 9:58 GMT+08:00 gaolv123...@163.com <gaolv123...@163.com>: > version infos : > > Kylin 1.5.1 > HBase 1.1.4 for apache package > hadoop cdh5.7 > > > > gaolv123...@163.com > > From: ShaoFeng Shi >

Re: How to do DateDiff in Kylin

2016-06-11 Thread ShaoFeng Shi
ut that has not > been implemented. > > Julian > > > On Fri, Jun 10, 2016 at 7:54 AM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > I don't see such a function in Calcite (Kylin's SQL parser): > > https://calcite.apache.org/docs/reference.html#da

Re: kylin_client_tool.py

2016-05-25 Thread ShaoFeng Shi
nor that this email message is free of > viruses, interceptions, or interference. > -- Best regards, Shaofeng Shi

Re: How to do DateDiff in Kylin

2016-06-10 Thread ShaoFeng Shi
ains date) > > ____ > From: ShaoFeng Shi <shaofeng...@apache.org> > Sent: Thursday, June 9, 2016 8:22:08 PM > To: dev@kylin.apache.org > Subject: Re: How to do DateDiff in Kylin > > Hi Uma, could you please give a sample SQL with DateDiff? > > 2016-06-

Re: How to do DateDiff in Kylin

2016-06-11 Thread ShaoFeng Shi
This has been in Calcite for quite a few releases. > > > > > On Jun 11, 2016, at 3:27 AM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > > Julian, from which version Calcite supports the minus operation between > two > > dates? > > > > I t

Re: 答复: 答复: 答复: snapshot table not update

2016-06-11 Thread ShaoFeng Shi
Issue created, please subscribe it for update: https://issues.apache.org/jira/browse/KYLIN-1780 2016-06-12 11:54 GMT+08:00 yubo-...@yolo24.com <yubo-...@yolo24.com>: > Yes. All rows in the table changed > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > ml-node+s74782n491

Re: 答复: 答复: snapshot table not update

2016-06-11 Thread ShaoFeng Shi
Is the table content changed in between? 2016-06-12 10:55 GMT+08:00 yubo-...@yolo24.com <yubo-...@yolo24.com>: > I updated all the rows. > > Actually, I dropped the table and created it again. > > 发件人: ShaoFeng Shi-2 [via Apache Kylin] [mailto: > ml-node+s74782n490...@n6.

Re: 配置问题

2016-06-08 Thread ShaoFeng Shi
) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > 2016-06-09 00:41:05,335 INFO [Thread-1] > client.ConnectionManager$HConnectionImplementation: Closing zookeeper > sessionid=0x15530aec581000a > 2016-06-09 00:41:05,349 INFO [main-EventThread] zookeeper.ClientCnxn: > EventThread shut down > 2016-06-09 00:41:05,354 INFO [Thread-1] zookeeper.ZooKeeper: Session: > 0x15530aec581000a closed -- Best regards, Shaofeng Shi

Re: stream build problem

2016-06-08 Thread ShaoFeng Shi
I guess you're running the master branch, which is unstable; suggest to use the latest released version 1.5.2.1. For the error you reported, a JIRA is created: https://issues.apache.org/jira/browse/KYLIN-1777 Thanks; 2016-06-09 10:19 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: >

Re: Unable build sample cube.Failing at Step 2

2016-05-30 Thread ShaoFeng Shi
even there i am not abed to see any > job. > > Job is not submitting to Hadoop. > > > Can i know any solution for this > Regards, > Mahesh > -- Best regards, Shaofeng Shi

Re: question about the joint dimension and query

2016-05-26 Thread ShaoFeng Shi
llows, where should I configure? > # java.lang.OutOfMemoryError: Java heap space > # -XX:OnOutOfMemoryError="kill -9 %p" > # Executing /bin/sh -c "kill -9 1909"... -- Best regards, Shaofeng Shi

Re: Understanding the cube building process

2016-05-26 Thread ShaoFeng Shi
here any presentation, blog post, that gives and overview of > > these > > > > internals? I did find [1] but I'm looking go descend another level. > I'm > > > > curious about the various steps involved (looks like it ran 18 > "steps" > > > and > > > > 10 MR jobs), what they're doing. I'm also curious about the schema > > design > > > > for the data model in HBase. > > > > > > > > Thanks in advance! > > > > -n > > > > > > > > [0]: http://kylin.apache.org/docs15/tutorial/kylin_sample.html > > > > [1]: http://www.slideshare.net/YangLi43/design-cube-in-apache-kylin > > > > > > > > > > -- Best regards, Shaofeng Shi

Re: [ANNOUNCE] Apache Kylin 1.5.2 released

2016-05-26 Thread ShaoFeng Shi
hanks, > The Apache Kylin Team > > [1] https://kylin.apache.org/docs15/release_notes.html > [2] https://kylin.apache.org/download/ > -- Best regards, Shaofeng Shi

Re: kylin hbase 1.2.1

2016-06-15 Thread ShaoFeng Shi
l.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > 2016-06-15 17:06:42,218 INFO [Thread-1] > client.ConnectionManager$HConnectionImplementation: Closing zookeeper > sessionid=0x155534c2e010006 > 2016-06-15 17:06:42,313 INFO [Thread-1] zookeeper.ZooKeeper: Session: > 0x155534c2e010006 closed > 2016-06-15 17:06:42,329 INFO [main-EventThread] zookeeper.ClientCnxn: > EventThread shut down > -- Best regards, Shaofeng Shi

Re: GHow to query TOP-N

2016-06-13 Thread ShaoFeng Shi
yes 2016-06-14 0:40 GMT+08:00 Jie Tao <jie@gameforge.com>: > > shall I use "select sum(price) group by seller_id" for the defined measure > TOP_SELLER with sum(price) and seller_id? > > Cheers, > > Jie > -- Best regards, Shaofeng Shi

Re: 答复: Re: Timeout visiting cube!

2016-06-21 Thread ShaoFeng Shi
: 吴钰彬 > > 主题: Re: 答复: Timeout visiting cube! > > There must be something wrong during cube build. If you are using > > 1.5.2, there is a diagnosis tool that extract useful info that helps > diagnose. > > > > On Wed, Jun 8, 2016 at 10:07 AM, ShaoFeng Shi <shaofeng..

Re: Kylin failed to startup

2016-06-22 Thread ShaoFeng Shi
re.java:93) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) > at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:880) > > > is there any problem in kylin.properties setting of > kylin_metadata@hbase ? thx > > > > > > -- Best regards, Shaofeng Shi

Re: [jira] [Created] (KYLIN-1813) intermediate table in Hive not cleaned up

2016-06-22 Thread ShaoFeng Shi
gt; intermediate hive table with job id >> 8a377e30-e3ba-4fe2-be12-e7d412afec5ewith job status ERROR >> >> In this case the intermediate tables were not removed from hive (see >> hive.png). The json is also attached json.txt >> >> >> >> -- >> This message was sent by Atlassian JIRA >> (v6.3.4#6332) >> > > -- Best regards, Shaofeng Shi

Re: Extract Fact Table Distinct Columns problem

2016-06-16 Thread ShaoFeng Shi
s doing, Can do a simple function > description? > > > > In this FactDistinctColumnsJob.class , Line 80 ,List > columnsNeedDict = cubeMgr.getAllDictColumnsOnFact(cubeDesc) : The method to > realize the function of what. > > > > > > > > > > Thanks! > > > > > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
tually drops useless intermediate tables after cube building, but > > I still see one "kylin_intermediate_cubename_searchdata" table for each > > cube building in Hive. Are these tables still usefull for Kylin? I use > > Kylin 1.5.2.1. > > > > Cheers, > > > > Jie > > > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
BTW, are you using a view as lookup table? 2016-06-17 15:15 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > This is common; If you have a job failed in between, and you discard that > job, the "Garbage collection" step will not be executed, so the g

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
? > > Jie > > > Am 17.06.2016 um 10:31 schrieb ShaoFeng Shi: > >> Hi Jie, >> >> If a job is "ERROR", the intermediate hive table of it will not be >> dropped, >> as "ERROR" is not a final state; User can resume an "Error"

Re: DISTINCT_COUNT精确计算问题

2016-06-21 Thread ShaoFeng Shi
distinct xx) 函数统计好像只支持 int类型的统计. > > 希望可以帮到你. > > Roy > > > > > 在 2016-06-21 15:08:46,"仇同心" <qiutong...@jd.com> 写道: > >大家好: > > > Hive字段类型为varchar,字段内容也包含英文字母和中文,对这样的字段能否做DISTINCT_COUNT精确计算?如果不能,有什么好的建议吗? > > > >谢谢! > -- Best regards, Shaofeng Shi

Re: kylin question

2016-06-21 Thread ShaoFeng Shi
://apache-kylin.74782.x6.nabble.com/java-lang-NoSuchMethodError-org-apache-hadoop-hbase-coprocessor-RegionCoprocessorEnvironment-getRegi-tp4698p5061.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-21 Thread ShaoFeng Shi
. My Kylin is 1.5.2.1. > > Cheers, > > Jie > > > Am 17.06.2016 um 11:05 schrieb ShaoFeng Shi: > >> by default the web UI only shows the jobs in LAST ONE WEEK, pls have a >> check. >> >> 2016-06-17 16:58 GMT+08:00 Jie Tao <jie@gameforge.com>

Re: join & left join in kylin

2016-06-20 Thread ShaoFeng Shi
snowflake schema in data warehouse? > 2.If Kylin can only support star schema, under what circumstances shall > we use join instead of left join? > > > look forward to your help, thx~ > > > > > > > -- > 李寅威 | CVTE > cor...@foxmail.com > 广州视源电子科技股份有限公司 > Guangzhou Shiyuan Electronics Co., Ltd. -- Best regards, Shaofeng Shi

Re: Timeout visiting cube

2016-06-21 Thread ShaoFeng Shi
] Cuboid Ids: [1048062] Total scan > count: 0 Result row count: 0 Accept Partial: true Is Partial Result: false > Hit Exception Cache: false Storage cache used: false > Message: Error while executing SQL "select count(distinct userid) from > cortanauu LIMIT 5": Timeout visiting cube! > ==[QUERY]=== > > > > -Original Message- > From: hongbin ma [mailto:mahong...@apache.org] > Sent: Wednesday, June 15, 2016 10:09 PM > To: dev <dev@kylin.apache.org> > Subject: Re: Timeout visiting cube > > ​actually, can you please attach latest 2 minutes' log before > 2016-06-15 02:18:22,741? > it's still incomplete for our analysis > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: > https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fkylin.io=01%7c01%7cjiaoli%40064d.mgd.microsoft.com%7ce53a04299632406e334208d395269be8%7c72f988bf86f141af91ab2d7cd011db47%7c1=vpTxGJMsJQ7CoMHsEjHWBxaRVgQWfLVp6mcuFmlqzzI%3d > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Number of cube dimensions is limited to 62?

2016-06-17 Thread ShaoFeng Shi
t regards > -- > Victoria Tskhay > > *Java Backend Developer*I glispa GmbH > > Sonnenburger Straße 73, 10437 Berlin, Germany > E victoria.tsk...@glispamedia.com e.mail.ru/compose/?mailto=mailto%3avictoria.tsk...@glispamedia.com> > Skype: vikatskhay I www.glispa.com <http://www.glispa.com> > > Sitz Berlin, AG Charlottenburg HRB 114678B > -- Best regards, Shaofeng Shi

Re: 问下怎么调试sample.sh

2016-06-20 Thread ShaoFeng Shi
ar ${job_jar} > org.apache.kylin.common.persistence.ResourceTool upload > ${KYLIN_HOME}/sample_cube/metadata > 这段我想debug查看执行过程应该怎么做? -- Best regards, Shaofeng Shi

Re: Kylin and Tableau -- Top N query

2016-01-16 Thread ShaoFeng Shi
ble? > No. It had only 1 month of data from hive tables. > c) Was the fact/lookup table data changed since cube be built? > No. > > > ShaoFeng Shi-2 wrote > > How much difference between Hive and Kylin? Did you check some factors > > like: a) any filtering condition in

Re: TopN Results Differ in Hive and Kylin

2016-01-16 Thread ShaoFeng Shi
in which way are you connecting to Kylin, ODBC, JDBC, Rest API or the web UI?

Re: beg suggestions to speed up the Kylin cube build

2016-01-14 Thread ShaoFeng Shi
ully utilize the resource? > > Looking forward to hear from you. > > Best regards, > Zhong > -- Best regards, Shaofeng Shi

Re: Kylin and Tableau -- Top N query

2016-01-14 Thread ShaoFeng Shi
MM > > The query shows different Top N records in Tableau as compared to Kylin and > Hive. > > Thanks, > Regards, > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/Kylin-and-Tableau-Top-N-query-tp3250.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: beg suggestions to speed up the Kylin cube build

2016-01-14 Thread ShaoFeng Shi
t; >> >> step ‘convert to hfile’, which is same as the region count. > >> >> > >> >> I think we could increase the number of reducers, to improve > >> performance. > >> >> If anyone has interesting in this, we could discuss more about th

Re: kylin.hdfs.working.dir becoming too large

2016-06-28 Thread ShaoFeng Shi
Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: kylin intermediate tables in Hive

2016-06-17 Thread ShaoFeng Shi
gt; intermediate hive table with job id 8a377e30-e3ba-4fe2-be12-e7d412afec5e > with job status ERROR > > Best regards, > > Jie > > > Am 17.06.2016 um 09:16 schrieb ShaoFeng Shi: > >> BTW, are you using a view as lookup table? >> >> 2016-06-17 15:15 GMT+0

Re: re-use Hive and Hbase from another kylin cluster issue

2016-02-07 Thread ShaoFeng Shi
what's the version of your new and old kylin? 发送自 Outlook Mobile On Sat, Feb 6, 2016 at 2:49 PM -0800, "greg gu" wrote: I originally have a kylin cluster, I deleted it without deleting the Hbase and Hive storages. now I created a new kylin cluster and would

Re: [VOTE] Release apache-kylin-2.0-alpha (release candidate 1)

2016-02-09 Thread ShaoFeng Shi
.apache.org/content/repositories/orgapachekylin-1018/ > > > > > > > >Release artifacts are signed with the following key: > > > >https://people.apache.org/keys/committer/liyang.asc > > > > > > > >Please vote on releasing this package as Apache Kylin 2.0-alpha. > > > > > > > >The vote is open for the next 72 hours and passes if a majority of at > > > >least > > > >three +1 PPMC votes are cast. > > > > > > > >[ ] +1 Release this package as Apache Kylin 1.2 > > > >[ ] 0 I don't feel strongly about it, but I'm okay with the release > > > >[ ] -1 Do not release this package because... > > > > > > > > > > > >Here is my vote: > > > > > > > >+1 (binding) > > > > > > > >-- > > > >Best regards, > > > > > > > >Yang > > > > > > > > > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Kylin.sandbox=true in config

2016-01-29 Thread ShaoFeng Shi
nfigure is > deploy.env=Dev|QA|prod > > what's the differences of the three values? > > Greg > > Sent from my iPhone > > > On Jan 28, 2016, at 7:06 PM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > > set Kylin.sandbox=false will start to use LDAP

Re: elastic search as kylin storage engine

2016-01-27 Thread ShaoFeng Shi
icSearchTupleIterator" > ,Otherwise, excute > > "org.apache.kylin.storage.elasticsearch.SerializedElasticAggregationTupleIterator" > > the count() function is blocked before the SQLDigest,so it does not support > count() now. > > thanks! > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/elastic-search-as-kylin-storage-engine-tp3429p3470.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: Exact distinct count support

2016-01-28 Thread ShaoFeng Shi
set again, but with the new cubing algo (2.x branch) should be > > simpler to add ? > > > >If currently not present are there any plans to introduce this ? > > > > Regards, > > Abhilash > > > -- Best regards, Shaofeng Shi

Re: N Cuboids preparation MapReduce - Trying to avoid multiple stage read

2016-02-01 Thread ShaoFeng Shi
ing-to-avoid-multiple-stage-read-tp3528p3531.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: StringIndexOutOfBoundsException: String index out of range: -1

2016-02-03 Thread ShaoFeng Shi
to a cubing job, it's a separate task to help > modeling. > >> can you checkout the output in /tmp/kylin/cardinality/KYLIN_DK.DIM_DTM, > it > >> seems the content format is not as expected: > >> > https://github.com/apache/kylin/blob/kylin-1.2/job/src/main/java/org/apache/kylin/job/hadoop/cardinality/HiveColumnCardinalityUpdateJob.java#L113 > >> > >> > >> > >> -- > >> Regards, > >> > >> *Bin Mahone | 马洪宾* > >> Apache Kylin: http://kylin.io > >> Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: how to bootstrap kylin example project/cube in 2.x-staging

2016-02-03 Thread ShaoFeng Shi
rted kylin server in IDE, but need run job to get example > project/cube) > > Thanks > -- Best regards, Shaofeng Shi

Re: only one reducer in job

2016-02-02 Thread ShaoFeng Shi
, which cause > the job to run very long time. > > I found this https://issues.apache.org/jira/browse/KYLIN-1066, it > mentioned the issue is fixed. > > > > If there a way to change the number of reducer? > > > > Thanks, > > > > > > > > -- Best regards, Shaofeng Shi

Re: Exact distinct count support

2016-01-28 Thread ShaoFeng Shi
/jira/browse/KYLIN-1186> is not a > mature feature yet and it only supports integer > we don't yet have plans to support any other forms of precise distinct > count, as it is too expensive to pre-calculate > > On Thu, Jan 28, 2016 at 6:56 PM, Abhilash L L <abhil...@infoworks.io>

Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase 1.0

2016-02-27 Thread ShaoFeng Shi
this message in context: > http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3742.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase 1.0

2016-02-28 Thread ShaoFeng Shi
CY_DIM_ORC.CCY_KEY > WHERE DT_DIM_ORC.DT_KEY=date'2015-03-03' > GROUP BY > CCY_DIM_ORC.CCY_NM, DT_DIM_ORC.CDR_YR > ORDER BY TOT_USD_TXN_AMT DESC > > > > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3745.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: no projects in the Kylin UI

2016-01-25 Thread ShaoFeng Shi
the late update. And thanks so much for taking time to help. Sorry once again. Best regards, Zhong B On Sun, Jan 24, 2016 at 8:47 AM, ShaoFeng Shi wrote: > I think Zhong's problem has got fixed by himself. Other guys please ignore. > > For the people ask question in mailing list: when you found

Re: internal hive table and build the cube backward

2016-01-19 Thread ShaoFeng Shi
gt; It's well known that the input of Kylin cube is hive table. Does it > make > > > any difference > > > between using internal hive table and external hive table when building > > the > > > cube? > > > > > > Best regards, > > > Zhong > > > > > > -- Best regards, Shaofeng Shi

Re: Patch Review Request for EAGLE-1363 and EAGLE-1355

2016-01-27 Thread ShaoFeng Shi
Thanks Hao! 2016-01-27 21:54 GMT+08:00 hongbin ma <mahong...@apache.org>: > merged > > thank you for your contribution Hao > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: Hive error when running kylin

2016-04-06 Thread ShaoFeng Shi
in/bin/..//logs/kylin.log > > -- > Regards > *Yagyank chadha* > > *Undergraduate student* > *Computer Science Engineering* > *Thapar University, Patiala* > -- Best regards, Shaofeng Shi

Re: Re: Cube bulid success,insight no display table

2016-04-08 Thread ShaoFeng Shi
> port 7070. so we need modify some config? > > > > > > > > > At 2016-04-08 17:02:32, "ShaoFeng Shi" <shaofeng...@apache.org> wrote: > >is your kylin in a singleton mode or cluster mode? does it listen on port > >7070? > > > >2016

Re: [VOTE] Release apache-kylin-1.5.1 (release candidate 1)

2016-04-09 Thread ShaoFeng Shi
chekylin-1024 > >> > >> > >> Release artifacts are signed with the following key: > >> https://people.apache.org/keys/committer/lidong.asc > >> > >> > >> Please vote on releasing this package as Apache Kylin 1.5.1. > >> > >> > >> The vote is open for the next 72 hours and passes if a majority of > >> at least three +1 PPMC votes are cast. > >> > >> > >> [ ] +1 Release this package as Apache Kylin 1.5.1 > >> [ ] 0 I don't feel strongly about it, but I'm okay with the release > >> [ ] -1 Do not release this package because... > >> > >> > >> Here is my vote: > >> > >> > >> +1 (binding) > >> > >> > >> Thanks, > >> Dong Li > > -- Best regards, Shaofeng Shi

Re: Welcome new committer and PMC member

2016-04-11 Thread ShaoFeng Shi
>Xiaoyu Wang and Dong Li to become PMC member, and they both accepted. > > > >They have made significant contributions, patches, also activity > >answer others questions and issues in Kylin's community. > > > >Welcome:) > > > >Luke > > > >On behalf of the Apache Kylin PPMC > > -- Best regards, Shaofeng Shi

Re: 遇到该问题怎么解决

2016-04-12 Thread ShaoFeng Shi
ion.getClass(Configuration.java:2110) > ... 8 more -- Best regards, Shaofeng Shi

Re: an error occurred when build a sample cube at step 5:create HTable

2016-04-12 Thread ShaoFeng Shi
; http://apache-kylin.74782.x6.nabble.com/an-error-occurred-when-build-a-sample-cube-at-step-5-create-HTable-tp4102p4140.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: Does INMEM Cubing algorithm release in v1.3?

2016-04-06 Thread ShaoFeng Shi
" + seg + " is " + alg);) > > Is there some docs describ the inmem cubing algorithm ? Is this one ( > http://www.infoq.com/cn/articles/apache-kylin-algorithm)? > -- Best regards, Shaofeng Shi

Re: Can we choose layered cubing or im-memory cubing manually

2016-03-26 Thread ShaoFeng Shi
> Best regards, > Yanghong Zhong > yangzh...@ebay.com > -- Best regards, Shaofeng Shi

Re: About the function of the "Refresh" button under tab "System"

2016-03-26 Thread ShaoFeng Shi
nfig" is not persisted to the configuration file. ​A brutal reload > will clear all the changes being made. > > > > -- > Regards, > > *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io > Github: https://github.com/binmahone > -- Best regards, Shaofeng Shi

Re: [VOTE] Release apache-kylin-1.3 (release candidate 1)

2016-03-07 Thread ShaoFeng Shi
is open for the next > 72 hours and passes if a majority of at least three +1 PPMC votes are cast. > [ ] +1 Release this package as Apache Kylin 1.3 [ ] 0 I don't feel strongly > about it, but I'm okay with the release [ ] -1 Do not release this package > because... Here is my vote: +1 (binding) -- Regards, *Bin Mahone | 马洪宾* > Apache Kylin: http://kylin.io Github: https://github.com/binmahone -- Best regards, Shaofeng Shi

Re: multiple user in kylin

2016-03-08 Thread ShaoFeng Shi
in support multiple user besides ADMIN? > This may be useful when integrating kylin in our workflow, we may need > to > do isolation work between different users in hdfs/mr/hive/hbase. > > Thanks. > > -- > Ding Dinghua > -- Best regards, Shaofeng Shi

Re: [jira] [Created] (KYLIN-1089) Kylin failed to run on CDH with HBase 1.0

2016-03-03 Thread ShaoFeng Shi
egards, > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/jira-Created-KYLIN-1089-Kylin-failed-to-run-on-CDH-with-HBase-1-0-tp2027p3784.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: VER1.5 -- Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]

2016-03-28 Thread ShaoFeng Shi
} > }, > { > "name": "USD_TXN_AMT", > "function": { > "expression": "SUM", > "returntype": "decimal(32,8)", > "parameter": { > "type": "column", > "value": "USD_TXN_AMT", > "next_parameter": null > } > } > } > ], > "rowkey": { > "rowkey_columns": [ > { > "column": "CST_NM", > "encoding": "dict" > }, > { > "column": "DT_KEY", > "encoding": "dict" > } > ] > }, > "aggregation_groups": [ > { > "includes": [ > "CST_NM", > "DT_KEY" > ], > "select_rule": { > "hierarchy_dims": [], > "mandatory_dims": [], > "joint_dims": [] > } > } > ], > "partition_date_start": 138853440, > "notify_list": [], > "hbase_mapping": { > "column_family": [ > { > "name": "f1", > "columns": [ > { > "qualifier": "m", > "measure_refs": [ > "_COUNT_", > "USD_TXN_AMT" > ] > } > ] > } > ] > }, > "retention_range": "0", > "auto_merge_time_ranges": [ > 60480, > 241920 > ], > "engine_type": 2, > "storage_type": 2 > } > > Thanks, > Regards, > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/VER1-5-Cannot-find-rowkey-column-DT-KEY-in-cube-CubeDesc-name-TEST-CUBE-tp3982.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: Kylin UI: Enable partition date column to support date and hour as separate columns

2016-03-30 Thread ShaoFeng Shi
browse/KYLIN-1441 > > and for backend, need to check the multiple days issue, we have a jira here > > https://issues.apache.org/jira/browse/KYLIN-1513?filter=-3 > > > On Wed, Mar 30, 2016 at 11:07 AM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > @Dip

Re: VER1.5 -- Cannot find rowkey column DT_KEY in cube CubeDesc [name=TEST_CUBE]

2016-03-30 Thread ShaoFeng Shi
_KEY". If the cube is created through GUI then pls report a JIRA. > > Btw this bug has been fixed in earlier version. It come back again?! > > On Tue, Mar 29, 2016 at 11:21 AM, ShaoFeng Shi <shaofeng...@apache.org> > wrote: > > > This is a bug, could you please repo

Re: V1.5 query no results

2016-03-30 Thread ShaoFeng Shi
what was changed. Your suggested Hadoop version is > 2.4-2.7. So I work with Hadoop 2.7. > > Best regards, > > Jie > > > Am 29.03.2016 um 12:35 schrieb ShaoFeng Shi: > >> I checked this query in my sandbox with 1.5.0 binary package, it can >> return >> recor

Re: V1.5 query no results

2016-03-29 Thread ShaoFeng Shi
se > Storage cache used: false > Message: null > > > I created a cube with my own table and also no results. I installed v1.2 > earlier but I deleted all tables (including kylin_metadata) in Hbase. I > think there should be no problem now with version conflict. But I did not > de

Re: V1.5 query no results

2016-03-31 Thread ShaoFeng Shi
I will wait. Now I work with v1.3. It is fine > with my Hbase and Hadoop. > > Best regards, > > Jie > > > > Am 30.03.2016 um 16:36 schrieb ShaoFeng Shi: > >> Hi Jie, >> >> I compared the hadoop version in 1.5 and 1.3, they are almost the same, >>

Re: How to create a streaming model.

2016-04-13 Thread ShaoFeng Shi
to create a streaming model. > > I don't know how to configure kafka topics,is it just a simple string(such > as "topic1")? > and where to configure kafka address > -- Best regards, Shaofeng Shi

Re: version question

2016-04-14 Thread ShaoFeng Shi
https://kylin.apache.org/docs15/install/hadoop_env.html 2016-04-14 18:18 GMT+08:00 耳东 <775620...@qq.com>: > hi all: > > >The latest apache kylin should be installed on what version of hive > hbase and hadoop? -- Best regards, Shaofeng Shi

Re: Question about cube size estimation in Kylin 1.5

2016-04-26 Thread ShaoFeng Shi
= rows(cuboid) x row_size(cuboid) x coefficient > > where coefficient = has_memory_hungry_measures(cube) ? 0.05 : 0.25 > > > > > > Why do we multiply the coefficient? And why it's five times smaller in > > memory hungry case? Cloud someone explain the rationale behind it? > > > > > > Thanks, Dayue > > > > > > > > > > > > > > > > > -- Best regards, Shaofeng Shi

Re: KYLIN-955 not work

2016-04-28 Thread ShaoFeng Shi
/org/apache/hadoop/conf/Configuration.html#addResource(org.apache.hadoop.conf.Configuration) > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/KYLIN-955-not-work-tp4313.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: cube data and insight are not synchronized

2016-04-28 Thread ShaoFeng Shi
any delay in its receipt or > damage to your system. Envision Energy Limited does not guarantee the > integrity of this email message, nor that this email message is free of > viruses, interceptions, or interference. > -- Best regards, Shaofeng Shi

Re: how to get the rate value

2016-04-26 Thread ShaoFeng Shi
_NAME SUCC ATT ATT/SUCC > CSMME15BZX 336981 368366 0 > CSMME32BZX 338754 366842 0 > CSMME07BZX 687965 747694 0 > CSMME03BHW 703269 747623 0 > CSMME12BZX 705856 764656 0 > CSMME16BHW 1962293142173 0 -- Best regards, Shaofeng Shi

Re: Question about cube size estimation in Kylin 1.5

2016-04-26 Thread ShaoFeng Shi
The issue is very likely related with https://issues.apache.org/jira/browse/KYLIN-1624; You can wait for v1.5.2, or pick the commits related with HLL (on master branch) made by Yang yesterday. 2016-04-26 17:49 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > Hi Dayue, > > c

Re: multi hadoop cluster

2016-04-26 Thread ShaoFeng Shi
n will > build cube in 5 minutes, but the result htable has no data. > > > I guess kylin doesn't fetch data from remote hdfs, and kylin doesn't tell > me it can't fetch data, > > > > > so can you help me to resolve it ? > > > > > -- 原始邮件

Re: Re: Re:Re: No detail message when Error.

2016-04-26 Thread ShaoFeng Shi
cipal() is > org.springframework.security.core.userdetails.User@3b40b2f: Username: > ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; > credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: > ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER > 2016-04-26 13:33:56,826 DEBUG [http-bio-7070-exec-8] > controller.ProjectController:97 : authentication.getPrincipal() is > org.springframework.security.core.userdetails.User@3b40b2f: Username: > ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; > credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: > ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER > 2016-04-26 13:33:56,891 DEBUG [http-bio-7070-exec-1] > service.QueryService:289 : getting table metas > 2016-04-26 13:33:56,893 DEBUG [http-bio-7070-exec-1] > service.QueryService:307 : getting column metas > 2016-04-26 13:33:56,905 DEBUG [http-bio-7070-exec-1] > service.QueryService:321 : done column metas > 2016-04-26 13:34:12,127 INFO [pool-4-thread-1] > threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, > 0 ready, 43 others > > > > > > > At 2016-04-25 17:00:28, "Roger Shi" <rogershijich...@hotmail.com> wrote: > >Hi Roy, > > > >Would you please provide all related logs fetched from > >$KYLIN_HOME/logs/kylin.log? It will help in reproducing the issue and > >finding the root cause. > > > >-- > >View this message in context: > http://apache-kylin.74782.x6.nabble.com/No-detail-message-when-Error-tp4152p4260.html > >Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: cardinality number limit about raw expression

2016-04-26 Thread ShaoFeng Shi
ation for this limited number for raw > expression(measure). > > -- > View this message in context: > http://apache-kylin.74782.x6.nabble.com/cardinality-number-limit-about-raw-expression-tp4286.html > Sent from the Apache Kylin mailing list archive at Nabble.com. > -- Best regards, Shaofeng Shi

Re: multi hadoop cluster

2016-04-26 Thread ShaoFeng Shi
t; > > but "kylin_intermediate_cube8_2016030100_2016041300" locate > "hdfs://bihbasemaster/" > > > they are different clusters. > > > The current situation is there will not be any error in WEBUI at step > 1, > > > When cube done, there is nothing in Htable, so What can i do? -- Best regards, Shaofeng Shi

Re: kylin安装后看不到默认的三张表

2016-04-28 Thread ShaoFeng Shi
> ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER > 2016-04-28 19:27:45,455 DEBUG [http-bio-7070-exec-9] > controller.UserController:64 : authentication.getPrincipal() is > org.springframework.security.core.userdetails.User@3b40b2f: Username: > ADMIN; Password: [PROTECTED]; Enabled: true; AccountNonExpired: true; > credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: > ROLE_ADMIN,ROLE_ANALYST,ROLE_MODELER > 2016-04-28 19:28:18,014 INFO [pool-2-thread-1] > threadpool.DefaultScheduler:106 : Job Fetcher: 0 running, 0 actual running, > 0 ready, 17 others > > -- > -- > 接口平台项目组-田伟 > 电话:150 1410 4760 > 外网邮箱:372861...@qq.com > 内网邮箱:tian.wei...@zte.com.cn > QQ: 372861232 > -- > > > > > > > > -- 原始邮件 -- > 发件人: "lidong";<lid...@apache.org>; > 发送时间: 2016年4月28日(星期四) 晚上7:32 > 收件人: "dev"<dev@kylin.apache.org>; > > 主题: 回复: kylin安装后看不到默认的三张表 > > > > Please provide the log, otherwise we are not able to help. > > > Thanks, > Dong > > > Original Message > Sender:︶ㄣ溡簡~~372861...@qq.com > Recipient:dev...@kylin.apache.org > Date:Thursday, Apr 28, 2016 19:11 > Subject:回复: kylin安装后看不到默认的三张表 > > > yes,Please help to see. > > > > > --原始邮件-- > 发件人:"lidong";lid...@apache.org; > 发送时间:2016年4月28日(星期四) 晚上7:08 > 收件人:"dev"dev@kylin.apache.org; > 主题:Re: kylin安装后看不到默认的三张表 > > > Have you checked logs/kylin.log? > > > Thanks, > Dong > > > Original Message > Sender:︶ㄣ溡簡~~372861...@qq.com > Recipient:dev...@kylin.apache.org > Date:Thursday, Apr 28, 2016 18:52 > Subject:kylin安装后看不到默认的三张表 > > > 采用集群分布方式,各版本如下 hadoop-2.4.0.tar.gz hbase-0.98.3-hadoop2-bin.tar.gz > apache-hive-0.13.1-bin.tar.gz apache-kylin-1.5.1-bin.tar.gz > -- > -- Best regards, Shaofeng Shi

Re: [VOTE] Release apache-kylin-1.5.2 (release candidate 3)

2016-05-24 Thread ShaoFeng Shi
package as Apache Kylin 1.5.2. > > > > The vote is open for the next 72 hours and passes if a majority of > > at least three +1 PPMC votes are cast. > > > > [ ] +1 Release this package as Apache Kylin 1.5.2 > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > Here is my vote: > > +1 (binding) > > > > Thanks, > > Dong Li > > > -- Best regards, Shaofeng Shi

Re: Help to go through your lira tickets

2016-05-11 Thread ShaoFeng Shi
version: > v1.5.2”, or label it as“fix version: v1.5.3” > > > Also it is preferable if you can go through your recent JIRA ticket > by“project = KYLIN AND assignee= currentUser() ORDER BY updated DESC”to see > if any resolved issues’s fix version being v1.5.2 > > > Thanks, > Dong Li -- Best regards, Shaofeng Shi

Re: About Cube List

2016-05-16 Thread ShaoFeng Shi
; > way > > > Monitor do. > > > > > > Best Wishes! > > > > > > > > > > > -- > > Regards, > > > > *Bin Mahone | 马洪宾* > > Apache Kylin: http://kylin.io > > Github: https://github.com/binmahone > > > -- Best regards, Shaofeng Shi

  1   2   3   4   5   6   7   8   9   10   >