Re: [DISCUSS] Columnar storage engine for Apache Kylin

2018-10-01 Thread ShaoFeng Shi
more character: cloud-native storage support. > Quite a few users are using S3 on AWS, or Azure Data Lake Storage on > Azure. If new storage engine could be more cloud friendly, more user > could get benefits from it. > > With Warm regards > > Billy Liu > ShaoFeng Shi 于2

[jira] [Created] (KYLIN-3606) Unstable KylinUserManagerTest

2018-09-29 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3606: --- Summary: Unstable KylinUserManagerTest Key: KYLIN-3606 URL: https://issues.apache.org/jira/browse/KYLIN-3606 Project: Kylin Issue Type: Bug Affects

[jira] [Created] (KYLIN-3605) Fix security issues reported by snyk.io

2018-09-29 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3605: --- Summary: Fix security issues reported by snyk.io Key: KYLIN-3605 URL: https://issues.apache.org/jira/browse/KYLIN-3605 Project: Kylin Issue Type: Improvement

Re: Re: [DISCUSS] Columnar storage engine for Apache Kylin

2018-09-29 Thread ShaoFeng Shi
nar storage files > should be Kylin specified. We can leverage the advantages of other columnar > files, like data skip indexes, bloom filters, dictionaries. Then create a > new file format with Kylin specified requirements, like cuboid info. > > > >-- > >Best rega

Re: [DISCUSS] Columnar storage engine for Apache Kylin

2018-09-28 Thread ShaoFeng Shi
tionaries. Then create a new file > format with Kylin specified requirements, like cuboid info. > > -- > Best regards, > Yanghong Zhong > > > On 9/28/18, 2:15 PM, "ShaoFeng Shi" wrote: > > Hi Kylin developers. > > HBase has been Kylin’s st

Re: regarding creating and modifying cube

2018-09-28 Thread ShaoFeng Shi
d-partition-cut-mb" on cube building performance. > > how to decide the optimum value of > "kylin.engine.spark.rdd-partition-cut-mb" for cube creation? > > -- Best regards, Shaofeng Shi 史少锋

[DISCUSS] Columnar storage engine for Apache Kylin

2018-09-27 Thread ShaoFeng Shi
/post/kylin-on-druid.html-- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3597) Fix sonar reported static code issues

2018-09-25 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3597: --- Summary: Fix sonar reported static code issues Key: KYLIN-3597 URL: https://issues.apache.org/jira/browse/KYLIN-3597 Project: Kylin Issue Type: Improvement

Re: Re:Kylin concurrent issue for query engine;

2018-09-25 Thread ShaoFeng Shi
+1 to add this into Kylin documentation. huaicui <270922...@qq.com> 于2018年9月25日周二 下午5:22写道: > I want to enable this function in V2.5.0, but i don't how to use this > PreparedStatement. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: [Announce] Apache Kylin 2.5.0 released

2018-09-23 Thread ShaoFeng Shi
ty. > > With Warm regards > > Billy Liu > ShaoFeng Shi 于2018年9月19日周三 上午8:31写道: > > > > The Apache Kylin team is pleased to announce the immediate availability > of the 2.5.0 release. > > > > This is a major release after 2.4, with more than 100 enhancemen

Re: Kylin-Master-JDK-1.8 failures

2018-09-23 Thread ShaoFeng Shi
> build starts' and now > https://builds.apache.org/job/Kylin-Master-JDK-1.8/2317/ finished > successfully. > Keep an eye on those failures, I only spotted them 'cuz of cleaning H26. > > Cheers, > -Pono > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3577) Mvn dependency warnings

2018-09-22 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3577: --- Summary: Mvn dependency warnings Key: KYLIN-3577 URL: https://issues.apache.org/jira/browse/KYLIN-3577 Project: Kylin Issue Type: Improvement Affects

[jira] [Created] (KYLIN-3576) IllegalArgumentException: No enum constant org.apache.kylin.rest.service.JobService.JobSearchMode.

2018-09-22 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3576: --- Summary: IllegalArgumentException: No enum constant org.apache.kylin.rest.service.JobService.JobSearchMode. Key: KYLIN-3576 URL: https://issues.apache.org/jira/browse/KYLIN-3576

Re: String型日期做为分区字段,在cube编译后,sql无法查询。请帮忙看看原因,谢谢!

2018-09-20 Thread ShaoFeng Shi
64.E6FED010] > > > > 可以成功查到Day字段的值: > > > > [cid:image002.png@01D44F64.E6FED010] > > > > 但是, 当使用以Day做为查询条件的sql时,都会报错: > > [cid:image005.png@01D44F65.10DAC150] > > > > [cid:image006.png@01D44F65.69803C90] > > > > 想咨询一下,是否string类型的日期,在kylin里不能做为分区字段所导致的吗?谢谢! > > > -- Best regards, Shaofeng Shi 史少锋

Re: [Discuss] Exclude Spark from Kylin's binary package

2018-09-19 Thread ShaoFeng Shi
rds > > Billy Liu > > ShaoFeng Shi 于2018年9月18日周二 下午5:35写道: > > > > Hello, > > > > Today Kylin's binary package ships an Apache Spark binary, the total > package is 297 MB in v2.5.0; I noticed that if the package is above 300 MB, > it would be rejected

[jira] [Created] (KYLIN-3571) Not build Spark in Kylin's binary package

2018-09-19 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3571: --- Summary: Not build Spark in Kylin's binary package Key: KYLIN-3571 URL: https://issues.apache.org/jira/browse/KYLIN-3571 Project: Kylin Issue

Re: kylin 编译出错

2018-09-18 Thread ShaoFeng Shi
gt; *主题:* kylin 编译出错 > > 编译kylin 源码 apache-kylin-2.4.1 > 执行命令:build/script/package.sh -P cdh5.7 > -- > yangz...@30wish.net > > -- Best regards, Shaofeng Shi 史少锋

Apache Kylin FAQ updated

2018-09-18 Thread ShaoFeng Shi
Hello, The FAQ page got updated together with v2.5.0 release; Please refresh to see the changes: https://kylin.apache.org/docs/gettingstarted/faq.html If you have a question to be added to this page, just let me know. -- Best regards, Shaofeng Shi 史少锋

[Announce] Apache Kylin 2.5.0 released

2018-09-18 Thread ShaoFeng Shi
ed to the 2.5.0 release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best regards, Shaofeng Shi 史少锋

[Discuss] Exclude Spark from Kylin's binary package

2018-09-18 Thread ShaoFeng Shi
ill reduce 2/3 package size, and save time/bandwidth for distributing Kylin. If you see a problem this change may bring, please complain. -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3563) Web UI style upgrade

2018-09-17 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3563: --- Summary: Web UI style upgrade Key: KYLIN-3563 URL: https://issues.apache.org/jira/browse/KYLIN-3563 Project: Kylin Issue Type: Improvement

[RESULT] [VOTE] Release apache-kylin-2.5.0 (RC2)

2018-09-16 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Yanghong Zhong Luke Han Dong Li 5 non-binding +1s: Na Zhai Lijun Cao Chao Long Shaoxiong Zhan Rongchuan Jin No 0s or -1s. Therefore I am delighted

Re: [DISCUSS] Change on Apache Kylin logo

2018-09-16 Thread ShaoFeng Shi
ine improvement from the old. > > Thanks, > Neethu > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[VOTE] Release apache-kylin-2.5.0 (RC2)

2018-09-12 Thread ShaoFeng Shi
cast. [ ] +1 Release this package as Apache Kylin 2.5.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Please note, from this version, Kylin need Java 8+ and Maven 3.5.3+. Here is my vote: +1 (binding) -- Best rega

[CANCELLED][VOTE] Release apache-kylin-2.5.0 (RC1)

2018-09-12 Thread ShaoFeng Shi
> Java version: 1.8.0_91, vendor: Oracle Corporation, runtime: > /Library/Java/JavaVirtualMachines/jdk1.8.0_91.jdk/Contents/Home/jre > Default locale: en_US, platform encoding: UTF-8 > OS name: "mac os x", version: "10.13.6", arch: "x86_64", family: "mac"

Re: [VOTE] Release apache-kylin-2.5.0 (RC1)

2018-09-12 Thread ShaoFeng Shi
Except for Java 8 requirement, it also needs Maven 3.5.4; Please upgrade before verifying the artifacts. Thanks! ShaoFeng Shi 于2018年9月12日周三 下午9:03写道: > Hi all, > > I have created a build for Apache Kylin 2.5.0, release candidate 1. > > Changes highlights: > > [KYLIN-2565]

[VOTE] Release apache-kylin-2.5.0 (RC1)

2018-09-12 Thread ShaoFeng Shi
27;t feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Please note, from this version, Kylin need Java 8 or above, please avoid using Java 7 to verify. Here is my vote: +1 (binding) -- Best regards, Shaofeng Shi 史少锋

Re: apache kylin vs apache druid

2018-09-12 Thread ShaoFeng Shi
sa. > > -- > Sent from: > https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache-kylin.74782.x6.nabble.com%2F&data=02%7C01%7Cyangzhong%40ebay.com%7C3e89491dea5c49a69a7a08d6189460cc%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C636723422885782475&sdata=iFql6SQBCDHslVj7ggM78eOvs2vOP53HDj5ZYnuKJsg%3D&reserved=0 > > > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3554) Spark job failed but Yarn shows SUCCEED, causing Kylin move to next step

2018-09-11 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3554: --- Summary: Spark job failed but Yarn shows SUCCEED, causing Kylin move to next step Key: KYLIN-3554 URL: https://issues.apache.org/jira/browse/KYLIN-3554 Project: Kylin

Re: Need Suggestion for a usecase where my hive table schema changes periodically.

2018-09-10 Thread ShaoFeng Shi
; > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3551) Spark job failed with "FileNotFoundException"

2018-09-10 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3551: --- Summary: Spark job failed with "FileNotFoundException" Key: KYLIN-3551 URL: https://issues.apache.org/jira/browse/KYLIN-3551 Project: Kylin Issue

[jira] [Created] (KYLIN-3550) "kylin.source.hive.flat-table-field-delimiter" has extra "\" when create intermediate flat table

2018-09-10 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3550: --- Summary: "kylin.source.hive.flat-table-field-delimiter" has extra "\" when create intermediate flat table Key: KYLIN-3550 URL: https://issues.apache.org/ji

Kylin Branches for Hadoop 3.1/HBase 2.0

2018-09-10 Thread ShaoFeng Shi
binary package with "build/scripts/package.sh", but the "cdh57" profile won't work I think. We will investigate Cloudera CDH 6.0 later to see whether its API is compatible. -- Best regards, Shaofeng Shi 史少锋

Re: Need Suggestion for a usecase where my hive table schema changes periodically.

2018-09-10 Thread ShaoFeng Shi
ult. > > 2. Can I use hybrid concept in this case. Is it that hybrid can be used > only > when you don't need to refresh cube_2 with historical data? > > Please help. > > Thanks, > Neethu > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: CUBE_NOT_CONTAIN_ALL_COLUMN Error while Joining two cubes

2018-09-10 Thread ShaoFeng Shi
mean? > > Thanks, > Neethu > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: Re:Query Problem

2018-09-10 Thread ShaoFeng Shi
the raw metric value from kylin? > > Thanks, > Neethu > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: Extract Fact Table Distinct Columns Error

2018-09-10 Thread ShaoFeng Shi
mpatibility issue with hadoop. > If it is so, then why don't we get warning during installation of kylin. > > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: [DISCUSS] Change on Apache Kylin logo

2018-09-09 Thread ShaoFeng Shi
The new Logo has "TM" added now: https://github.com/apache/kylin/blob/document/website/assets/images/ApacheKylin_Logo_Adjust.png ShaoFeng Shi 于2018年9月10日周一 上午11:25写道: > Thanks for Julian's feedback! Yes, we can add "TM" to the logo, just like > Apache Spark

Re: [Announce] Apache Kylin 2.4.1 released

2018-09-09 Thread ShaoFeng Shi
t results in sub-second, via ODBC, JDBC > > or RESTful API. > > > > Thanks everyone who have contributed to the 2.4.1 release. > > > > We welcome your help and feedback. For more information on how to > > report problems, and to get involved, visit the project website at > > https://kylin.apache.org/ > -- Best regards, Shaofeng Shi 史少锋

Re: [DISCUSS] Change on Apache Kylin logo

2018-09-09 Thread ShaoFeng Shi
;re doing graphic design, should we also create a "powered by > Apache Kylin" logo? [2] > > Julian > > [1] https://www.apache.org/foundation/marks/pmcs#graphics > > [2] https://www.apache.org/foundation/marks/pmcs#poweredby > On Fri, Sep 7, 2018 at 1:27 AM Billy Liu

Re: [DISCUSS] Change on Apache Kylin logo

2018-09-06 Thread ShaoFeng Shi
If you couldn't see the image, please check this link: https://github.com/apache/kylin/blob/document/website/assets/images/ApacheKylin_Logo_Adjust.png ShaoFeng Shi 于2018年9月7日周五 下午2:26写道: > Hello, Kylin community, > > We invited an experienced visual designer to revise Apache Kyl

[DISCUSS] Change on Apache Kylin logo

2018-09-06 Thread ShaoFeng Shi
ise the discussion to get your inputs; If no objection we will use the new version to replace the old one. Please express your comments freely. Thanks! [image: ApacheKylin_Logo_Adjust.png] -- Best regards, Shaofeng Shi 史少锋

Re: [VOTE] Release apache-kylin-2.4.1 (RC1)

2018-09-06 Thread ShaoFeng Shi
BTW, if you got "No route to host" error when download yanghong's gpg key, adding a key server like this: gpg --keyserver hkp://ipv4.pool.sks-keyservers.net:80 --recv-keys 94906A1C ShaoFeng Shi 于2018年9月7日周五 下午2:11写道: > > +1 binding; > > mvn clean package and mvn te

Re: [VOTE] Release apache-kylin-2.4.1 (RC1)

2018-09-06 Thread ShaoFeng Shi
> https://people.apache.org/keys/committer/nju_yaho.asc > > > > > > Please vote on releasing this package as Apache Kylin 2.4.1. > > > > > > The vote is open for the next 72 hours and passes if a majority of > > > at least three +1 PPMC votes are cast. > > > > > > [ ] +1 Release this package as Apache Kylin X.Y.Z > > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > > [ ] -1 Do not release this package because... > > > > > > > > > Here is my vote: > > > > > > +1 (binding) > > > > > > > > > Best regards, > > > Yanghong Zhong > > > > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3527) Hybrid couldn't save when there is only 1 cube

2018-09-03 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3527: --- Summary: Hybrid couldn't save when there is only 1 cube Key: KYLIN-3527 URL: https://issues.apache.org/jira/browse/KYLIN-3527 Project: Kylin Issue Type

Re: Hive table design (multiple fact tables or rolled up)

2018-09-03 Thread ShaoFeng Shi
clarify. > > Thanks, > Neethu > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3524) Clone cube reports "Overwriting conflict /project/learn_kylin.json" error

2018-09-02 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3524: --- Summary: Clone cube reports "Overwriting conflict /project/learn_kylin.json" error Key: KYLIN-3524 URL: https://issues.apache.org/jira/browse/KYLIN-3524 Proj

Branch cut for Kylin 2.5

2018-09-01 Thread ShaoFeng Shi
Hi Kylin developers, As most features of Kylin 2.5 have been done, and now there are some PRs won't go to 2.5, the "2.5.x" branch. If you have change need to be included in 2.5, please double commit/pr. -- Best regards, Shaofeng Shi 史少锋

Re: 关于kylin参数kylin.source.hive.keep-flat-table配置问题

2018-08-31 Thread ShaoFeng Shi
+ hiveTable + ";"); > > > output.append("Hive table " + hiveTable + " is > dropped. \n"); > } > } > config.getCliCommandExecutor().execute(hiveCmdBuilder.build( > )); > rmdirOnHDFS(getExternalDataPaths()); > output.append("Path " + getExternalDataPaths() + " is deleted. > \n"); > > > return output.toString(); > } -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3521) Enable Cube Planner by default

2018-08-31 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3521: --- Summary: Enable Cube Planner by default Key: KYLIN-3521 URL: https://issues.apache.org/jira/browse/KYLIN-3521 Project: Kylin Issue Type: Improvement

Re: [Announce] New Apache Kylin PMC Yanghong Zhong

2018-08-30 Thread ShaoFeng Shi
te all of Yonghong's generous contributions about many bug > fixes, patches, helped many users. We are so glad to have him to be our > new PMC and looking forward to his continued involvement. > > Congratulations and Welcome, Yonghong! > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3518) Coprocessor reports NPE when execute a query on HBase 2.0

2018-08-27 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3518: --- Summary: Coprocessor reports NPE when execute a query on HBase 2.0 Key: KYLIN-3518 URL: https://issues.apache.org/jira/browse/KYLIN-3518 Project: Kylin Issue

[jira] [Created] (KYLIN-3517) Couldn't update coprocessor on HBase 2.0

2018-08-27 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3517: --- Summary: Couldn't update coprocessor on HBase 2.0 Key: KYLIN-3517 URL: https://issues.apache.org/jira/browse/KYLIN-3517 Project: Kylin Issue Type

Re: The algorithm used is "layer", but why in-mem step while building the cube?

2018-08-27 Thread ShaoFeng Shi
gorithm, but I see a > step > called "Build Cube In-Mem". > 1. What does this step do? > 2. So by-layer also uses in-mem at this step? > > Please clarify my doubt. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3513) Release 2.5.0

2018-08-24 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3513: --- Summary: Release 2.5.0 Key: KYLIN-3513 URL: https://issues.apache.org/jira/browse/KYLIN-3513 Project: Kylin Issue Type: Task Reporter: Shaofeng

Re: What is the meaning of "executablePO is null"

2018-08-24 Thread ShaoFeng Shi
> Can anyone please explain whats happening? Does that mean kylin does not > find any task to execute and hence throw this error? If so, how can I > handle > this. > If I resume the job build, it then starts running properly. Please help. > > -- > Sent from: http://apache-kylin

[jira] [Created] (KYLIN-3504) Release 2.4.1

2018-08-20 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3504: --- Summary: Release 2.4.1 Key: KYLIN-3504 URL: https://issues.apache.org/jira/browse/KYLIN-3504 Project: Kylin Issue Type: Task Reporter: Shaofeng

Apache Kylin Meetup @Bay Area 29 Aug

2018-08-20 Thread ShaoFeng Shi
ssion. Here is the event page: https://www.meetup.com/BigDataApps/events/253429041/ -- Best regards, Shaofeng Shi 史少锋

Re: 求助:kylin 返回 localhost:18032 failed错误

2018-08-10 Thread ShaoFeng Shi
DH、HDP这些, > > 从公司层面也不现实,而现在接入kylin就报这个错误,不知道是否是版本问题?或者是不支持开源apache > > hadoop?还是请求大师能协助处理一下, 我们万分感激! > > > > 2018-08-10 10:17 GMT+08:00 ShaoFeng Shi : > > > >> Hi Terry, > >> > >> I see your email several days ago, but I have no idea about the

[jira] [Created] (KYLIN-3488) Support MySQL as Kylin metadata storage

2018-08-10 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3488: --- Summary: Support MySQL as Kylin metadata storage Key: KYLIN-3488 URL: https://issues.apache.org/jira/browse/KYLIN-3488 Project: Kylin Issue Type: New Feature

Re: 求助:kylin 返回 localhost:18032 failed错误

2018-08-09 Thread ShaoFeng Shi
at > org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:614) > at > org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:712) > at org.apache.hadoop.ipc.Client$Connection.access$2900(Client.java:375) > at org.apache.hadoop.ipc.Client.getConnection(Client.java:1528) > at org.apache.hadoop.ipc.Client.call(Client.java:1451) > ... 31 more > result code:2 > > > -- Best regards, Shaofeng Shi 史少锋

Apache Kylin meetup on 8/11 @Beijing

2018-08-07 Thread ShaoFeng Shi
/event/7452131278400 <http://www.huodongxing.com/event/7452131278400>* -- Best regards, Shaofeng Shi 史少锋

Re: One question about set up apache Kylin at Azure Hdinsight cluster

2018-08-05 Thread ShaoFeng Shi
dency... > Retrieving hbase dependency... > Retrieving hadoop conf dir... > Retrieving kafka dependency... > Retrieving Spark dependency... > find: тАШ/usr/hdp/current/spark-client/jarsтАЩ: No such file or directory > spark jars not found > > > Regards, > Jiangxu > -- Best regards, Shaofeng Shi 史少锋

Re: 回复:如何用API删除job

2018-07-30 Thread ShaoFeng Shi
> >------ 原始邮件 -- > >发件人: "鲨鱼"<786510...@qq.com>; > >发送时间: 2018年7月30日(星期一) 上午10:27 > >收件人: "dev"; > > > >主题: 如何用API删除job > > > > > > > >你好, > >想问下如何用API删除job > -- Best regards, Shaofeng Shi 史少锋

Re: Re: Re: [Feature][Query]Case insensitive and configurable casing handle feature, may I contribute it?

2018-07-30 Thread ShaoFeng Shi
is the info variable. > > > > > > > > > 在 2018-07-30 15:41:50,"ShaoFeng Shi" 写道: > >Do you know whether Calcite supports that? If Calcite already supports it > >with some parameter, Kylin can expose that as a configuration. > > > >BTW, w

Re: 怎么样定时从hive获取表更新

2018-07-30 Thread ShaoFeng Shi
件人: "dev"; > > 主题: 回复:怎么样定时从hive获取表更新 > > > > 官方提供加载hive表的API :load hive tables , > 用法如下:http://kylin.apache.org/docs/howto/howto_use_restapi. > html#load-hive-tables > > > 可以用shell脚本调用API,再把这个脚本写入服务器定时服务中 > > > -- 原始邮件 -- > 发件人: "邱祥吉"; > 发送时间: 2018年7月30日(星期一) 上午10:41 > 收件人: "dev"; > > 主题: 怎么样定时从hive获取表更新 > > > > 请问,怎么样定时从hive获取表更新,谢谢! -- Best regards, Shaofeng Shi 史少锋

Re: Re: [Feature][Query]Case insensitive and configurable casing handle feature, may I contribute it?

2018-07-30 Thread ShaoFeng Shi
behavior, it would be better. > > > Truely the behavior is more attached to Apache Calcite, but Kylin is not > allow us to customize it. > > > I think we should give the choice for users. > > > > > > > > > At 2018-07-30 13:34:14, "ShaoFeng Shi" wro

Re: [Feature][Query]Case insensitive and configurable casing handle feature, may I contribute it?

2018-07-29 Thread ShaoFeng Shi
ake the case handling and quoting method is configurable > by kylin.properties, that a global configuration. > 2. Second make case handling and quoting method available by JDBC > connection url parameters or connection properties by > DriverManager.getConnection(url-with-parameters, extra-properties) > > > Are the features above is matter to contribute? Please give me feedback > and I will make a contribution. -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3472) TopN merge in Spark engine is slow

2018-07-27 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3472: --- Summary: TopN merge in Spark engine is slow Key: KYLIN-3472 URL: https://issues.apache.org/jira/browse/KYLIN-3472 Project: Kylin Issue Type: Bug

Apache Kylin meetup on 7/28 @Shanghai

2018-07-24 Thread ShaoFeng Shi
4399.com 4. Apache Superset (incubating) for Kylin It is open for registration. You're welcomed to join. Here is the link: http://www.huodongxing.com/event/2449364807100?td=4222685755750 -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3464) Less user confirmation

2018-07-23 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3464: --- Summary: Less user confirmation Key: KYLIN-3464 URL: https://issues.apache.org/jira/browse/KYLIN-3464 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-3462) "dfs.replication=2" and compression not work in Spark cube engine

2018-07-22 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3462: --- Summary: "dfs.replication=2" and compression not work in Spark cube engine Key: KYLIN-3462 URL: https://issues.apache.org/jira/browse/KYLIN-3462 Proj

Re: kylin相关sql

2018-07-15 Thread ShaoFeng Shi
master/jdbc/src/test/java/org/apache/kylin/jdbc/DriverTest.java 在 2018年7月13日 下午4:15,林锦明 写道: > 您好,请问kylin列出所有表的sql怎么写的,像Mysql是show tables,但是kylin的怎么写,期待您的回复,谢谢! -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3452) Optimize spark cubing memory footprint

2018-07-15 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3452: --- Summary: Optimize spark cubing memory footprint Key: KYLIN-3452 URL: https://issues.apache.org/jira/browse/KYLIN-3452 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-3449) Should allow deleting a segment in NEW status

2018-07-13 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3449: --- Summary: Should allow deleting a segment in NEW status Key: KYLIN-3449 URL: https://issues.apache.org/jira/browse/KYLIN-3449 Project: Kylin Issue Type

[jira] [Created] (KYLIN-3446) Convert to HFile in spark reports ZK connection refused

2018-07-12 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3446: --- Summary: Convert to HFile in spark reports ZK connection refused Key: KYLIN-3446 URL: https://issues.apache.org/jira/browse/KYLIN-3446 Project: Kylin Issue

[jira] [Created] (KYLIN-3443) Optimize cube job in Spark

2018-07-06 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3443: --- Summary: Optimize cube job in Spark Key: KYLIN-3443 URL: https://issues.apache.org/jira/browse/KYLIN-3443 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-3442) Fact distinct columns in Spark

2018-07-06 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3442: --- Summary: Fact distinct columns in Spark Key: KYLIN-3442 URL: https://issues.apache.org/jira/browse/KYLIN-3442 Project: Kylin Issue Type: Improvement

[jira] [Created] (KYLIN-3441) Merge cube segments in Spark

2018-07-06 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3441: --- Summary: Merge cube segments in Spark Key: KYLIN-3441 URL: https://issues.apache.org/jira/browse/KYLIN-3441 Project: Kylin Issue Type: Improvement

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-03 Thread ShaoFeng Shi
has > been changed to decimal(19,6). When I try to build the cube it says, it > gives me an error saying that "inconsistent cubedesc_signature". Is there > anything I should do for that? > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3440) Couldn't merge if there is an empty segment

2018-07-03 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3440: --- Summary: Couldn't merge if there is an empty segment Key: KYLIN-3440 URL: https://issues.apache.org/jira/browse/KYLIN-3440 Project: Kylin Issue Type

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-03 Thread ShaoFeng Shi
"next_parameter" : null }, "returntype" : "decimal(19,4)" } }, 2018-07-03 19:14 GMT+08:00 mvneethu : > Yes, I have sync the hive table again and seems to take the default > decimal(19,4). > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-03 Thread ShaoFeng Shi
ion=19 > and restarted kylin. But still I get the default as decimal(19,4). Please > help. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: How to configure the default data type measure decimal(19, 4)?

2018-07-02 Thread ShaoFeng Shi
gt; Currently, I am not able to select the data type of the measure. I want to > have decimal(19,6) but in my current version 2.2.0, kylin defaults the data > type to decimal(19,4). How can I change this? Please respond. > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3437) Optimize HBase connection pool in Kylin side

2018-07-02 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3437: --- Summary: Optimize HBase connection pool in Kylin side Key: KYLIN-3437 URL: https://issues.apache.org/jira/browse/KYLIN-3437 Project: Kylin Issue Type

Re: how to add a new database dialect

2018-07-02 Thread ShaoFeng Shi
o how to add this dialect? -- Best regards, Shaofeng Shi 史少锋

Apache Kylin Chinese documents updated / Kylin 中文文档已更新

2018-07-02 Thread ShaoFeng Shi
get the new content. We welcome public contribution on documents as well, regarding how to write and contribute, please check: https://kylin.apache.org/development/howto_docs.html -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3435) Only keep base cuboid files on HDFS for future merge

2018-07-01 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3435: --- Summary: Only keep base cuboid files on HDFS for future merge Key: KYLIN-3435 URL: https://issues.apache.org/jira/browse/KYLIN-3435 Project: Kylin Issue Type

Re: it run error when run step 1. Execution failed with exit status: 3

2018-06-30 Thread ShaoFeng Shi
1664416 percentage: 0.718 > 2018-07-01 10:46:50 Processing rows: 90 Hashtable size: 89 Memory > usage: 828289456 percentage: 0.792 > 2018-07-01 10:46:57 Processing rows: 100 Hashtable size: 99 Memory > usage: 908630072 percentage: 0.868 > 2018-07-01 10:47:11 Processing rows: 110 Hashtable size: 109 > Memory usage: 994774944 percentage: 0.951 > Execution failed with exit status: 3 > Obtaining error information > > Task failed! > Task ID: > Stage-34 > > Logs: > > /tmp/hdfs/hive.log > FAILED: Execution Error, return code 3 from org.apache.hadoop.hive.ql. > exec.mr.MapredLocalTask > > > > > apache_...@163.com > -- Best regards, Shaofeng Shi 史少锋

Re: [RESULT] [VOTE] Release apache-kylin-2.3.2 (RC2)

2018-06-30 Thread ShaoFeng Shi
Thank you Kaisen! 2018-06-30 17:20 GMT+08:00 kangkaisen : > Thanks to everyone who has tested the release candidate and given > their comments and votes. > > The tally is as follows. > > 5 binding +1s: > Shaofeng Shi > Yerui Sun > Dayue Gao > Billy Liu > Dong L

[jira] [Created] (KYLIN-3432) Merge segments from HBase snapshots

2018-06-27 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3432: --- Summary: Merge segments from HBase snapshots Key: KYLIN-3432 URL: https://issues.apache.org/jira/browse/KYLIN-3432 Project: Kylin Issue Type: Improvement

Re: [VOTE] Release apache-kylin-2.3.2 (RC2)

2018-06-27 Thread ShaoFeng Shi
n for the next 72 hours and passes if a majority of > at least three +1 PPMC votes are cast. > > [ ] +1 Release this package as Apache Kylin 2.3.2 > [ ] 0 I don't feel strongly about it, but I'm okay with the release > [ ] -1 Do not release this package because... > > > Here is my vote: > > +1 > > -- > Best regards, > > KaiSen Kang 康凯森 > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[jira] [Created] (KYLIN-3427) Convert to HFile in Spark

2018-06-26 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3427: --- Summary: Convert to HFile in Spark Key: KYLIN-3427 URL: https://issues.apache.org/jira/browse/KYLIN-3427 Project: Kylin Issue Type: Improvement

Re: [VOTE] Release apache-kylin-2.3.2 (RC1)

2018-06-25 Thread ShaoFeng Shi
source package issue, I will vote > apache-kylin-2.3.2 (RC2). > > -- > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

Re: [VOTE] Release apache-kylin-2.3.2 (RC1)

2018-06-25 Thread ShaoFeng Shi
e on releasing this package as Apache Kylin 2.3.2. > > > > The vote is open for the next 72 hours and passes if a majority of > > at least three +1 PPMC votes are cast. > > > > [ ] +1 Release this package as Apache Kylin 2.3.2 > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > > > Here is my vote: > > > > +1 > > > > -- > > Best regards, > > > > KaiSen Kang 康凯森 > > > > -- > > Sent from: http://apache-kylin.74782.x6.nabble.com/ > -- Best regards, Shaofeng Shi 史少锋

[Announce] Apache Kylin 2.4.0 released

2018-06-25 Thread ShaoFeng Shi
ks to everyone who has contributed to the 2.4.0 release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ -- Best regards, Shaofeng Shi 史少锋

[RESULT] [VOTE] Release apache-kylin-2.4.0 (RC1)

2018-06-23 Thread ShaoFeng Shi
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 4 binding +1s: Shaofeng Shi Dong Li Luke Han Billy Liu 3 non-binding +1s: Julian Pan Kaisen Kang Jianhua Peng No 0s or -1s. Therefore I am delighted to announce that the

Re: Doubt about Cube Planner

2018-06-22 Thread ShaoFeng Shi
max,min..etc > or any other constraint? > > Kindly guide me? > > > -- Best regards, Shaofeng Shi 史少锋

Re: [New Document] Setup JDBC data source in Kylin

2018-06-21 Thread ShaoFeng Shi
Moved to tutorial section: https://kylin.apache.org/docs23/tutorial/setup_jdbc_datasource.html 2018-06-20 17:54 GMT+08:00 ShaoFeng Shi : > Hello, > > Kylin 2.3 adds the support for JDBC data source. The document is added to > Kylin website: > > https://kylin.apach

[jira] [Created] (KYLIN-3422) Support multi-path of domain for kylin connection

2018-06-20 Thread Shaofeng SHI (JIRA)
Shaofeng SHI created KYLIN-3422: --- Summary: Support multi-path of domain for kylin connection Key: KYLIN-3422 URL: https://issues.apache.org/jira/browse/KYLIN-3422 Project: Kylin Issue Type

<    1   2   3   4   5   6   7   8   9   10   >