Re: [VOTE] Release apache-kylin-4.0.0-beta (RC2)
+1 binding mvn test passed Thanks, Dong Li On Sat, Feb 6, 2021 at 7:02 PM Li Yang wrote: > +1 binding > mvn clean test passed > > On Fri, Feb 5, 2021 at 9:29 AM Zhichao Zhang <441586...@qq.com> wrote: > > > +1 from my side. > > Happy path on CDH5 and HDP 2 passed. > > > > Best regards, > > Zhichao Zhang >
Re: Re: [VOTE] Release apache-kylin-3.1.0 (RC1)
+1 (binding) mvn test passed Thanks, Dong Li On Tue, Jun 30, 2020 at 7:52 PM Guangxu Cheng wrote: > +1 (non-binding) > > - Signature: ok > - Checksum : ok > - Built from source (1.8.0_201): ok > - Unit tests pass (1.8.0_201): ok > - Start kylin server: ok > - Kylin Web UI:ok > -- > Best Regards, > Guangxu > > > Chao Long 于2020年6月30日周二 上午11:43写道： > > > +1 > > mvn test passed > > > > On Mon, Jun 29, 2020 at 1:09 PM Ma Gang wrote: > > > > > +1 (binding)mvn test pass, my test env is JDK8, mac. > > > > > > > > > > > > > > > -- > > > > > > Thanks, > > > Gang Ma > > > > > > > > > > > > > > > > > > 在 2020-06-29 10:56:50，"Yaqian Zhang" 写道： > > > >+1 > > > >Mvn clean test passed > > > > > > > >> 在 2020年6月29日，10:43，ShaoFeng Shi 写道： > > > >> > > > >> +1 (binding) > > > >> > > > >> I checked: > > > >> > > > >> - Compile successfully with JDK 8 on MacOS; > > > >> - "mvn test" success; > > > >> - The sha 256 hash is correct; > > > >> - The gpg signature is by n...@apache.org; > > > >> - The NOTICE and LICENSE files; > > > >> > > > >> > > > >> > > > >> Best regards, > > > >> > > > >> Shaofeng Shi 史少锋 > > > >> Apache Kylin PMC > > > >> Email: shaofeng...@apache.org > > > >> > > > >> Apache Kylin FAQ: > > https://kylin.apache.org/docs/gettingstarted/faq.html > > > >> Join Kylin user mail group: user-subscr...@kylin.apache.org > > > >> Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > > >> > > > >> > > > >> > > > >> > > > >> Rupeng Wang 于2020年6月29日周一 上午9:51写道： > > > >> > > > >>> +1 > > > >>> > > > >>> mvn test passed > > > >>> Binary package test passed on CDH6.0 > > > >>> > > > >>> > > > >>> --- > > > >>> Best wishes, > > > >>> Rupeng Wang > > > >>> > > > >>> > > > >>> > > > >>> 在 2020/6/29 09:33，“Zhong, Yanghong” > 写入: > > > >>> > > > >>>+1 (binding) > > > >>> > > > >>>mvn test passed. > > > >>> > > > >>>Best regards, > > > >>>Yanghong Zhong > > > >>> > > > >>>On 2020/6/28, 11:13 PM, "恩爸" <441586...@qq.com> wrote: > > > >>> > > > >>>External Email > > > >>> > > > >>> > > > >>>+1 from my side. > > > >>>Tested passed on CDH5 and HDP3. > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>>Best regards, > > > >>>Zhichao Zhang > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>> > > > >>>--原始邮件-- > > > >>>发件人:"George Ni" > > >>>发送时间:2020年6月28日(星期天) 晚上7:51 > > > >>>收件人:"dev" > > >>> > > > >>>主题:[VOTE] Release apache-kylin-3.1.0 (RC1) > > > >>> > > > >>> > > > >>> > > > >>>Hi all, > > > >>> > > > >>>I have created a build for Apache Kylin 3.1.0, release > > > candidate 1. > > > >>> > > > >>>Changes highlights: > > > >>>[KYLIN-4342] - Build Global Dict by MR/Hive New Version > > > >>>[KYLIN-3758] - Flink Cube Build Engine > > > >>>[KYLIN-3832] - Kylin pushdown to support PostgreSQL > > > >>>[KYLIN-4445] - Prov
Re: [VOTE] Release apache-kylin-2.6.6 (RC2)
+1 (binding) mvn test passed Thanks, Dong Li On Fri, May 15, 2020 at 6:50 PM Liukaige wrote: > +1 (no binding) > > Mvn test passed > > Zhong, Yanghong 于2020年5月15日周五 上午12:01写道： > > > +1 (binding) > > > > Mvn test successfully on Java 8. > > > > Best regards, > > Yanghong Zhong > > Apache Kylin PMC > > Email: nju_y...@apache.org > > > > On 2020/5/15, 8:47 AM, "ShaoFeng Shi" wrote: > > > > +1 (binding) > > > > Checked the signature and sha hash; > > 'Mvn test' build successfully on Java 8; > > > > Best regards, > > > > Shaofeng Shi 史少锋 > > Apache Kylin PMC > > Email: shaofeng...@apache.org > > > > Apache Kylin FAQ: > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fkylin.apache.org%2Fdocs%2Fgettingstarted%2Ffaq.htmldata=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=LJEdErMsxQwECLmAgnoMia40Lx2mNP%2FWWyr3xDJKYfc%3Dreserved=0 > > Join Kylin user mail group: user-subscr...@kylin.apache.org > > Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > > > > > > > > > Xiaoxiang Yu 于2020年5月14日周四 下午11:23写道： > > > > > +1 . > > > Maven test passed and happy path passed in CDH5.7. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > Best wishes to you ! > > > From ：Xiaoxiang Yu > > > > > > > > > > > > > > > > > > At 2020-05-14 17:06:55, "George Ni" wrote: > > > >Hi all, > > > > > > > > > > > > > > > >I have created a build for Apache Kylin 2.6.6, release candidate > 2. > > > > > > > > > > > > > > > >Changes highlights: > > > > > > > >[KYLIN-4390] - Update tomcat to 7.0.100 > > > > > > > >[KYLIN-4426] - Refine CliCommandExecutor > > > > > > > >[KYLIN-4206] - Support Glue as Hive Metatdata > > > > > > > > > > > > > > > >Thanks to everyone who has contributed to this release. > > > > > > > >Here are the release notes: > > > > > > > > > > > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fsecure%2FReleaseNote.jspa%3Fversion%3D12346976%26styleName%3D%26projectId%3D12316121data=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=36c%2BrngKbUKGzcoV%2BiWXatYYaddQjSEdTUpazsb3CA8%3Dreserved=0 > > > > > > > > > > > > > > > >The commit to being voted upon: > > > > > > > > > > > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fkylin%2Fcommit%2Fddd5f8ecd4157b8f889b047e421dd9cfae7e1142data=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=5g73LF70lEf%2BXQhLGkJFddVld%2BaKiVJgix9nKJidaX8%3Dreserved=0 > > > > > > > > > > > >Its hash is ddd5f8ecd4157b8f889b047e421dd9cfae7e1142. > > > > > > > > > > > > > > > >The artifacts to be voted on, including the source package and > four > > > > > > > >pre-compiled binary packages are located here: > > > > > > > > > > > https://nam01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdist.apache.org%2Frepos%2Fdist%2Fdev%2Fkylin%2Fapache-kylin-2.6.6-rc2%2Fdata=02%7C01%7Cyangzhong%40ebay.com%7Ce556eee242944e96221408d7f869907c%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C637251004593880249sdata=kFZAYJQRMm4J9fhjnO4Xhgjz2W9qy%2FtpvD25Yq9Mxf0%3Dreserved=0 > > > > > > > > > > > > > > > >The hash of the artifacts are as follows: > > > > > > > >apache-kylin-2.6.6-source-release.zip.sha256 > > > >6d38671f494e3d5f2bb26dfb94d996a5ceb0c00c2a17b9c181ad853639198d3a > > > > > > > >apache-kylin-2.6.6-bin-hbase1x.tar.gz.sha256 &
Re: [VOTE] Release apache-kylin-3.0.2 (RC2)
+1 (binding) mvn test passed Thanks, Dong Li On Fri, May 15, 2020 at 6:49 PM Liukaige wrote: > +1 (no binding) > > Mvn test passed > > Yaqian Zhang 于2020年5月15日周五 上午1:52写道： > > > +1 > > Mvn test passed > > > > > 在 2020年5月15日，08:44，ShaoFeng Shi 写道： > > > > > > +1 (binding) > > > > > > Checked the signature and sha hash; > > > 'Mvn test' build successfully on Java 8; > > > > > > Best regards, > > > > > > Shaofeng Shi 史少锋 > > > Apache Kylin PMC > > > Email: shaofeng...@apache.org > > > > > > Apache Kylin FAQ: > https://kylin.apache.org/docs/gettingstarted/faq.html > > > Join Kylin user mail group: user-subscr...@kylin.apache.org > > > Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > > > > > > > > > > > > > > Xiaoxiang Yu 于2020年5月14日周四 下午11:21写道： > > > > > >> +1 . > > >> Maven test passed and happy path passed in CDH5.7. > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> -- > > >> > > >> Best wishes to you ! > > >> From ：Xiaoxiang Yu > > >> > > >> > > >> > > >> > > >> > > >> At 2020-05-14 17:11:28, "George Ni" wrote: > > >>> Hi all, > > >>> > > >>> > > >>> > > >>> I have created a build for Apache Kylin 3.0.2, release candidate 2. > > >>> > > >>> > > >>> > > >>> Changes highlights: > > >>> > > >>> [KYLIN-4390] - Update tomcat to 7.0.100 > > >>> > > >>> [KYLIN-4426] - Refine CliCommandExecutor > > >>> > > >>> [KYLIN-4206] - Support Glue as Hive Metatdata > > >>> > > >>> > > >>> > > >>> Thanks to everyone who has contributed to this release. > > >>> > > >>> Here are the release notes: > > >>> > > >>> > > >> > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346975==12316121 > > >>> > > >>> > > >>> > > >>> The commit to being voted upon: > > >>> > > >>> > > >> > > > https://github.com/apache/kylin/commit/57090efe4bdc079ccfde4f9c8729d69ba3a90624 > > >>> > > >>> > > >>> Its hash is 57090efe4bdc079ccfde4f9c8729d69ba3a90624. > > >>> > > >>> > > >>> > > >>> The artifacts to be voted on, including the source package and four > > >>> > > >>> pre-compiled binary packages are located here: > > >>> > > >>> https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.0.2-rc2/ > > >>> > > >>> > > >>> > > >>> The hash of the artifacts are as follows: > > >>> > > >>> apache-kylin-3.0.2-source-release.zip.sha256 > > >>> 1add5892bd1d5994e0e467846e9a844758420f14819ceef63370c07a6aa0b8af > > >>> > > >>> apache-kylin-3.0.2-bin-hbase1x.tar.gz.sha256 > > >>> 086397d9ecbccf80517977a4b65b660b8e1496ad097d890226bd78a34a9fe190 > > >>> > > >>> apache-kylin-3.0.2-bin-cdh57.tar.gz.sha256 > > >>> 181929fcd35a63a81b6dc097137a3dd1e129fd1f81400e09f64019dcb7ac8a21 > > >>> > > >>> apache-kylin-3.0.2-bin-hadoop3.tar.gz.sha256 > > >>> c2250734fed971f32d242036a55ba955bcf8de91e0e73704e07cfb09124d9899 > > >>> > > >>> apache-kylin-3.0.2-bin-cdh60.tar.gz.sha256 > > >>> 83a68d2aec32e634475c490434981ebc91e8680dbb6388edc4ed919687ad1dac > > >>> > > >>> > > >>> > > >>> A staged Maven repository is available for review at: > > >>> > > >>> > > https://repository.apache.org/content/repositories/orgapachekylin-1078/ > > >>> > > >>> > > >>> > > >>> Release artifacts are signed with the following key: > > >>> > > >>> https://people.apache.org/keys/committer/nic.asc > > >>> > > >>> > > >>> > > >>> Please vote on releasing this package as Apache Kylin 3.0.2. > > >>> > > >>> > > >>> > > >>> The vote is open for the next 72 hours and passes if a majority of > > >>> > > >>> at least three +1 PMC votes are cast. > > >>> > > >>> > > >>> > > >>> [ ] +1 Release this package as Apache Kylin 3.0.2 > > >>> > > >>> [ ] 0 I don't feel strongly about it, but I'm okay with the release > > >>> > > >>> [ ] -1 Do not release this package because... > > >>> > > >>> > > >>> > > >>> > > >>> > > >>> Here is my vote: > > >>> > > >>> > > >>> > > >>> +1 (binding) > > >>> > > >>> -- > > >>> > > >>> - > > >>> > > >>> Best regards, > > >>> > > >>> > > >>> > > >>> Ni Chunen / George > > >> > > > > > > -- > Best regards, > > Kaige Liu(刘凯歌) > > *"Do small things with great love." * >
Re: [VOTE] Release apache-kylin-2.6.5 (RC2)
+1 binding gpg verified sha256 vertified mvn test passed [INFO] [INFO] Reactor Summary for Apache Kylin 2.6.5: [INFO] [INFO] Apache Kylin ... SUCCESS [ 5.905 s] [INFO] Apache Kylin - Core Common . SUCCESS [ 29.381 s] [INFO] Apache Kylin - Core Metadata ... SUCCESS [01:06 min] [INFO] Apache Kylin - Core Dictionary . SUCCESS [06:30 min] [INFO] Apache Kylin - Core Cube ... SUCCESS [01:34 min] [INFO] Apache Kylin - Core Metrics SUCCESS [ 3.401 s] [INFO] Apache Kylin - Core Job SUCCESS [ 51.575 s] [INFO] Apache Kylin - Core Storage SUCCESS [ 17.358 s] [INFO] Apache Kylin - MapReduce Engine SUCCESS [ 38.584 s] [INFO] Apache Kylin - Spark Engine SUCCESS [ 35.375 s] [INFO] Apache Kylin - Hive Source . SUCCESS [ 13.417 s] [INFO] Apache Kylin - DataSource SDK .. SUCCESS [ 20.108 s] [INFO] Apache Kylin - Jdbc Source . SUCCESS [ 41.249 s] [INFO] Apache Kylin - Kafka Source SUCCESS [ 16.965 s] [INFO] Apache Kylin - Cache ... SUCCESS [ 13.456 s] [INFO] Apache Kylin - HBase Storage ... SUCCESS [ 52.825 s] [INFO] Apache Kylin - Query ... SUCCESS [ 25.968 s] [INFO] Apache Kylin - Metrics Reporter Hive ... SUCCESS [ 4.250 s] [INFO] Apache Kylin - Metrics Reporter Kafka .. SUCCESS [ 2.218 s] [INFO] Apache Kylin - REST Server Base SUCCESS [ 41.860 s] [INFO] Apache Kylin - REST Server . SUCCESS [02:28 min] [INFO] Apache Kylin - JDBC Driver . SUCCESS [ 10.304 s] [INFO] Apache Kylin - Assembly SUCCESS [ 9.312 s] [INFO] Apache Kylin - Tool SUCCESS [ 25.472 s] [INFO] Apache Kylin - Tool Assembly ... SUCCESS [ 1.845 s] [INFO] Apache Kylin - Integration Test SUCCESS [ 30.938 s] [INFO] Apache Kylin - Tomcat Extension SUCCESS [ 1.230 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 19:53 min [INFO] Finished at: 2020-02-15T10:55:46+08:00 [INFO] My Environment: Apache Maven 3.6.0 (97c98ec64a1fdfee7767ce5ffb20918da4f719f3; 2018-10-25T02:41:47+08:00) Maven home: /opt/tools/apache-maven-3.6.0 Java version: 1.8.0_201, vendor: Oracle Corporation, runtime: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "3.10.0-957.10.1.el7.x86_64", arch: "amd64", family: "unix" Thanks, Dong Li On Fri, Feb 14, 2020 at 9:21 PM George Ni wrote: > Hi all, > > > > I have created a build for Apache Kylin 2.6.5, release candidate 2. > > > > Changes highlights: > > [KYLIN-4374] - Fix security issues reported by code analysis platform LGTM > > [KYLIN-4291] - Parallel segment building may causes WriteConflictException > > [KYLIN-4263] - Inappropriate exception handling causes job stuck on running > status > > [KYLIN-4169] - Too many logs during DataModelManager’s initiation, cause > the first RESTful API to hang for a long time > > > > Thanks to everyone who has contributed to this release. > > Here are the release notes: > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346281==12316121 > > > > The commit to being voted upon: > > > https://github.com/apache/kylin/commit/73d42edec5f6492b3d3ffc222c26dce4bdfe7263 > > > Its hash is 73d42edec5f6492b3d3ffc222c26dce4bdfe7263. > > > > The artifacts to be voted on, including the source package and four > > pre-compiled binary packages are located here: > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.6.5-rc2/ > > > > The hash of the artifacts are as follows: > > apache-kylin-2.6.5-source-release.zip.sha256 > > 32fb722a58ed49318dc5f72da429506238ee2089170236c742f22240d93080a3 > > apache-kylin-2.6.5-bin-hbase1x.tar.gz.sha256 > > f8e04fafa7e63cdeb28aa4e8c35bc2f54456888bef37d4cca060c424be722e1e > > apache-kylin-2.6.5-bin-cdh57.tar.gz.sha256 > > 71deb9bc84e5b75320e2c8ca358449f808ef2decbee11679e7f4339abeeb3d3f > > apache-kylin-2.6.5-bin-hadoop3.tar.gz.sha256 > > e77218204800a7b6be42e90e0fcb03e6e8458d600125e44bc112a8a359291fc4 > > apac
Re: [VOTE] Release apache-kylin-3.0.1 (RC2)
+1 binding sha verified gpg verified mvn test passed [INFO] [INFO] Reactor Summary for Apache Kylin 3.0.1: [INFO] [INFO] Apache Kylin ... SUCCESS [ 21.034 s] [INFO] Apache Kylin - Core Common . SUCCESS [ 42.695 s] [INFO] Apache Kylin - Core Metadata ... SUCCESS [01:04 min] [INFO] Apache Kylin - Core Dictionary . SUCCESS [05:33 min] [INFO] Apache Kylin - Core Cube ... SUCCESS [03:30 min] [INFO] Apache Kylin - Core Metrics SUCCESS [ 2.643 s] [INFO] Apache Kylin - Core Job SUCCESS [01:18 min] [INFO] Apache Kylin - Core Storage SUCCESS [ 12.795 s] [INFO] Apache Kylin - Stream Core . SUCCESS [01:27 min] [INFO] Apache Kylin - MapReduce Engine SUCCESS [ 38.625 s] [INFO] Apache Kylin - Spark Engine SUCCESS [ 34.734 s] [INFO] Apache Kylin - Hive Source . SUCCESS [ 17.022 s] [INFO] Apache Kylin - DataSource SDK .. SUCCESS [ 15.701 s] [INFO] Apache Kylin - Jdbc Source . SUCCESS [ 30.542 s] [INFO] Apache Kylin - Kafka Source SUCCESS [ 10.728 s] [INFO] Apache Kylin - Cache ... SUCCESS [ 12.757 s] [INFO] Apache Kylin - HBase Storage ... SUCCESS [ 56.876 s] [INFO] Apache Kylin - Query ... SUCCESS [ 24.251 s] [INFO] Apache Kylin - Metrics Reporter Hive ... SUCCESS [ 3.582 s] [INFO] Apache Kylin - Metrics Reporter Kafka .. SUCCESS [ 1.467 s] [INFO] Apache Kylin - Stream Source Kafka . SUCCESS [ 7.860 s] [INFO] Apache Kylin - Stream Coordinator .. SUCCESS [ 30.703 s] [INFO] Apache Kylin - Stream Receiver . SUCCESS [ 10.820 s] [INFO] Apache Kylin - Stream Storage .. SUCCESS [ 2.924 s] [INFO] Apache Kylin - REST Server Base SUCCESS [ 38.763 s] [INFO] Apache Kylin - REST Server . SUCCESS [03:46 min] [INFO] Apache Kylin - JDBC Driver . SUCCESS [ 7.765 s] [INFO] Apache Kylin - Assembly SUCCESS [ 13.129 s] [INFO] Apache Kylin - Tool SUCCESS [ 20.729 s] [INFO] Apache Kylin - Tool Assembly ... SUCCESS [ 1.033 s] [INFO] Apache Kylin - Integration Test SUCCESS [ 23.482 s] [INFO] Apache Kylin - Tomcat Extension SUCCESS [ 1.228 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 24:45 min [INFO] Finished at: 2020-02-14T23:35:07+08:00 [INFO] My Environment: Apache Maven 3.6.0 (97c98ec64a1fdfee7767ce5ffb20918da4f719f3; 2018-10-25T02:41:47+08:00) Maven home: /opt/tools/apache-maven-3.6.0 Java version: 1.8.0_201, vendor: Oracle Corporation, runtime: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "3.10.0-957.10.1.el7.x86_64", arch: "amd64", family: "unix" Thanks, Dong Li On Fri, Feb 14, 2020 at 9:12 PM George Ni wrote: > Hi all, > > > > I have created a build for Apache Kylin 3.0.1, release candidate 2. > > > > Changes highlights: > > [KYLIN-4374] - Fix security issues reported by code analysis platform LGTM > > [KYLIN-4333] - Memory leak on job server > > [KYLIN-4297] - Build cube throw NPE error when partition column is not set > in JDBC Data Source > > > > Thanks to everyone who has contributed to this release. > > Here are the release notes: > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346958==12316121 > > > > The commit to being voted upon: > > > https://github.com/apache/kylin/commit/818c21cc9c2a995a58d85497a8649ebcf11a975c > > > > Its hash is 818c21cc9c2a995a58d85497a8649ebcf11a975c. > > > > The artifacts to be voted on, including the source package and four > > pre-compiled binary packages are located here: > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-3.0.1-rc2/ > > > > The hash of the artifacts are as follows: > > apache-kylin-3.0.1-source-release.zip.sha256 > > 78cceaba517b7c62f0dfa6c4610144d7913051588d8a99083a89cf74e37a724f > > apache-kylin-3.0.1-bin-hbase1x.tar.gz.sha256 > > 9bf9db5e9152755928f08ebe9fa2dc0d2647feb56604ceb06343e95fd362dc50 > > apache-kylin-3.
Re: [VOTE] Release apache-kylin-3.0.1 (RC1)
+1 binding mvn test passed sha verified [INFO] Reactor Summary for Apache Kylin 3.0.1: [INFO] [INFO] Apache Kylin ... SUCCESS [ 4.659 s] [INFO] Apache Kylin - Core Common . SUCCESS [ 21.165 s] [INFO] Apache Kylin - Core Metadata ... SUCCESS [ 55.496 s] [INFO] Apache Kylin - Core Dictionary . SUCCESS [05:55 min] [INFO] Apache Kylin - Core Cube ... SUCCESS [03:26 min] [INFO] Apache Kylin - Core Metrics SUCCESS [ 0.544 s] [INFO] Apache Kylin - Core Job SUCCESS [01:09 min] [INFO] Apache Kylin - Core Storage SUCCESS [ 11.424 s] [INFO] Apache Kylin - Stream Core . SUCCESS [01:31 min] [INFO] Apache Kylin - MapReduce Engine SUCCESS [ 33.921 s] [INFO] Apache Kylin - Spark Engine SUCCESS [01:00 min] [INFO] Apache Kylin - Hive Source . SUCCESS [ 25.801 s] [INFO] Apache Kylin - DataSource SDK .. SUCCESS [ 23.935 s] [INFO] Apache Kylin - Jdbc Source . SUCCESS [ 47.599 s] [INFO] Apache Kylin - Kafka Source SUCCESS [ 20.755 s] [INFO] Apache Kylin - Cache ... SUCCESS [ 21.673 s] [INFO] Apache Kylin - HBase Storage ... SUCCESS [01:47 min] [INFO] Apache Kylin - Query ... SUCCESS [ 34.969 s] [INFO] Apache Kylin - Metrics Reporter Hive ... SUCCESS [ 7.713 s] [INFO] Apache Kylin - Metrics Reporter Kafka .. SUCCESS [ 3.806 s] [INFO] Apache Kylin - Stream Source Kafka . SUCCESS [ 15.985 s] [INFO] Apache Kylin - Stream Coordinator .. SUCCESS [ 49.782 s] [INFO] Apache Kylin - Stream Receiver . SUCCESS [ 19.732 s] [INFO] Apache Kylin - Stream Storage .. SUCCESS [ 11.171 s] [INFO] Apache Kylin - REST Server Base SUCCESS [01:08 min] [INFO] Apache Kylin - REST Server . SUCCESS [04:11 min] [INFO] Apache Kylin - JDBC Driver . SUCCESS [ 14.742 s] [INFO] Apache Kylin - Assembly SUCCESS [ 28.653 s] [INFO] Apache Kylin - Tool SUCCESS [ 39.160 s] [INFO] Apache Kylin - Tool Assembly ... SUCCESS [ 1.666 s] [INFO] Apache Kylin - Integration Test SUCCESS [ 47.622 s] [INFO] Apache Kylin - Tomcat Extension SUCCESS [ 2.762 s] [INFO] [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 29:17 min [INFO] Finished at: 2020-02-14T16:32:00+08:00 [INFO] My Environment: Apache Maven 3.6.0 (97c98ec64a1fdfee7767ce5ffb20918da4f719f3; 2018-10-25T02:41:47+08:00) Maven home: /opt/tools/apache-maven-3.6.0 Java version: 1.8.0_201, vendor: Oracle Corporation, runtime: /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "3.10.0-957.10.1.el7.x86_64", arch: "amd64", family: "unix" Thanks, Dong Li On Thu, Feb 13, 2020 at 4:35 PM ShaoFeng Shi wrote: > +1 binding; > > Verified the README, LICENSE and DEPENDENCIES are there; > Verified the SHA256 are good; > Verified the signature is from PMC Chunen Ni (need to load Chunen's > key: gpg --recv-keys 479A9809) > Compile success with Java 1.8.0_111 on Mac; > "mvn test" success as below: > > [INFO] Apache Kylin 3.0.1 . SUCCESS [ > 2.737 s] > [INFO] Apache Kylin - Core Common . SUCCESS [ > 12.490 s] > [INFO] Apache Kylin - Core Metadata ... SUCCESS [ > 35.841 s] > [INFO] Apache Kylin - Core Dictionary . SUCCESS [03:37 > min] > [INFO] Apache Kylin - Core Cube ... SUCCESS [01:51 > min] > [INFO] Apache Kylin - Core Metrics SUCCESS [ > 0.465 s] > [INFO] Apache Kylin - Core Job SUCCESS [01:06 > min] > [INFO] Apache Kylin - Core Storage SUCCESS [ > 5.582 s] > [INFO] Apache Kylin - Stream Core . SUCCESS [ > 47.223 s] > [INFO] Apache Kylin - MapReduce Engine SUCCESS [ > 16.109 s] > [INFO] Apache Kylin - Spark Engine SUCCESS [03:05 > min] > [INFO] Apache Kylin - Hive Source . SUCCESS [ > 5.036 s] > [INFO] Apache Kylin - DataSource SDK .
Re: [Draft][Report] Apache Kylin - Feb 2020
+1 Looks good for me. Thanks, Dong Li On Thu, Feb 13, 2020 at 3:49 PM ShaoFeng Shi wrote: > Hi all, > > Here's Kylin board report for this cycle, please help to review and leave > your feedback here. If some information needs to be added, please list here. > > > ## Description: > The mission of Apache Kylin is the creation and maintenance of software > related to a distributed and scalable OLAP engine > > ## Issues: > No issue need board's attention; > > ## Membership Data: > Apache Kylin was founded 2015-11-18 (4 years ago) There are currently 39 > committers and 23 PMC members in this project. The Committer-to-PMC ratio > is > roughly 5:3. > > Community changes, past quarter: > - Chunen Ni was added to the PMC on 2019-11-26 > - Xiaoxiang Yu was added as committer on 2019-12-27 > - Temple Zhou was added as committer on 2019-11-14 > > ## Project Activity: > Recent releases: > 3.0.0 was released on 2019-12-18. > 3.0.0-beta was released on 2019-10-24. > 2.6.4 was released on 2019-10-12. > > As across the year-end and beginning, there is no Meetup event in the past > 3 > months; But we have several online webinars to share the Kylin tutorial and > user scenarios, which attracts more than 100 audiences each time. > > ## Community Health: > dev@kylin.apache.org had a 7% increase in traffic in the past quarter (316 > emails compared to 294) iss...@kylin.apache.org had a 33% increase in > traffic > in the past quarter (2686 emails compared to 2011) 120 issues opened in > JIRA, > past quarter (no change) 96 issues closed in JIRA, past quarter (-33% > decrease) 343 commits in the past quarter (76% increase) 51 code > contributors > in the past quarter (34% increase) 161 PRs opened on GitHub, past quarter > (12% increase) 174 PRs closed on GitHub, past quarter (41% increase) > > The community is keeping growing; In Dec. of 2019 we just released the > new Kylin 3.0 version, we're looking forward to attracting more users to > Kylin! > > Best regards, > > Shaofeng Shi 史少锋 > Apache Kylin PMC > Email: shaofeng...@apache.org > > Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html > Join Kylin user mail group: user-subscr...@kylin.apache.org > Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > >
[jira] [Created] (KYLIN-3380) Allow to configure sqoop for jdbc source with a kylin_sqoop_conf.xml like hive
Dong Li created KYLIN-3380: -- Summary: Allow to configure sqoop for jdbc source with a kylin_sqoop_conf.xml like hive Key: KYLIN-3380 URL: https://issues.apache.org/jira/browse/KYLIN-3380 Project: Kylin Issue Type: Improvement Components: RDBMS Source Affects Versions: v2.3.1 Reporter: Dong Li In hive source, users can config hive with a kylin_hive_conf.xml under conf directory. But for jdbc source, where we use sqoop to make flatten table, users cannot customize the configuration according to the real environment. To fix this, we can have a kylin_sqoop_conf.xml file under conf directory, then users can specify some configurations for sqoop. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3363) Wrong partition condition appended in JDBC Source
Dong Li created KYLIN-3363: -- Summary: Wrong partition condition appended in JDBC Source Key: KYLIN-3363 URL: https://issues.apache.org/jira/browse/KYLIN-3363 Project: Kylin Issue Type: Improvement Components: RDBMS Source Reporter: Dong Li create a cube, and select the partition column from lookup table, then select shard by column from fact table. then an unexecutable sql will be created to build the flatten table with sqoop: select ... from [FACT] where [LOOKUP].[PARTITION_COL] > ... -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3354) KeywordDefaultDirtyHack cannot handle double-quoted defaultCatalog identifier
Dong Li created KYLIN-3354: -- Summary: KeywordDefaultDirtyHack cannot handle double-quoted defaultCatalog identifier Key: KYLIN-3354 URL: https://issues.apache.org/jira/browse/KYLIN-3354 Project: Kylin Issue Type: Improvement Reporter: Dong Li for example, following SQL cannot be escaped by KeywordDefaultDirtyHack: select count(*) from "defaultCatalog"."DEFAULT"."TABLE" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
Re: [Announce] Welcome new Apache Kylin committer :Julian Pan
Welcome Julian! Thanks, Dong Li On 2018/4/17, 09:58, "Billy Liu" <billy...@apache.org> wrote: Welcome Julian, congratus. With Warm regards Billy Liu 2018-04-17 9:20 GMT+08:00 Ted Yu <yuzhih...@gmail.com>: > Congratulations, Julian. > > On Mon, Apr 16, 2018 at 6:18 PM, Luke Han <luke...@apache.org> wrote: >> >> My fault, I have tried to send out this one week ago but somehow it not >> send out at that time, sorry about that. >> >> Let's welcome our new committer. >> >> Thanks. >> >> Luke Han <luke...@apache.org>于2018年4月17日周二 上午9:16写道： >>> >>> I am very pleased to announce that the Project Management Committee (PMC) >>> of Apache Kylin has asked Julian Pan to become Apache Kylin committer, and >>> he has already accepted. >>> >>> Jianhua has already made many contributions to Kylin community, to answer >>> others questions actively, submit patches for bug fixes and contribute to >>> some features. We are so glad to have him to be our new committer. >>> >>> Please join me to welcome Julian. >>> >>> Luke Han >>> >>> On behalf of the Apache Kylin PPMC > >
[jira] [Created] (KYLIN-3315) allow each project to set its own source in project level override configuration
Dong Li created KYLIN-3315: -- Summary: allow each project to set its own source in project level override configuration Key: KYLIN-3315 URL: https://issues.apache.org/jira/browse/KYLIN-3315 Project: Kylin Issue Type: Improvement Components: Metadata Reporter: Dong Li Currently, all projects connect to the same source which is set in kylin.properties with kylin.source.default property. It's better to allow each project to set its own source in project level override configuration. As the result, we can have project A connects to JDBC, and project B connects to Hive. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
Re: [VOTE] Release apache-kylin-2.3.1
+1 binding mvn test passed gpg, md5, sha1 verified Environment: Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T15:58:13+08:00) Maven home: /usr/local/Cellar/maven/3.5.2/libexec Java version: 1.8.0_101, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_101.jdk/Contents/Home/jre Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.13.3", arch: "x86_64", family: "mac" Thanks, Dong Li On 25/03/2018, 01:36, "Billy Liu" <billy...@apache.org> wrote: Hi all, I have created a build for Apache Kylin 2.3.1, release candidate 1. This is a bug fix release for Kylin 2.3.0 Changes highlights: [KYLIN-3270] Fix the blocking issue in cube optimizing jobs [KYLIN-3276] Fix the query cache bug with dynamic parameters [KYLIN-3287] When a shard by column is in dict encoding, dict building error. [KYLIN-3288] "Sqoop To Flat Hive Table" step should specify "mapreduce.queue.name" [KYLIN-3278] Kylin should not distribute hive table by random at Step1 [KYLIN-3300] Upgrade jackson-databind for security issue [KYLIN-3301] Upgrade opensaml for security issue 12 issues are fixed in this release. Thanks to everyone who has contributed to this release. Here’s release notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12342940 The commit to be voted upon: https://github.com/apache/kylin/commit/928cc1628c546efe7ec348c467f5d26607c8d7e6 Its hash is 928cc1628c546efe7ec348c467f5d26607c8d7e6. The artifacts to be voted on are located here: https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.1-rc1/ The hashes of the artifacts are as follows: apache-kylin-2.3.1-src.tar.gz.md5 541d8dff9e5caaae349cf61ad394b0d6 apache-kylin-2.3.1-src.tar.gz.sha1 7ff10d1770d05a8324252547f95adde990bde9dc A staged Maven repository is available for review at: https://repository.apache.org/content/repositories/orgapachekylin-1049/ Release artifacts are signed with the following key: https://people.apache.org/keys/committer/billyliu.asc Please vote on releasing this package as Apache Kylin 2.3.1. The vote is open for the next 72 hours and passes if a majority of at least three +1 PPMC votes are cast. [ ] +1 Release this package as Apache Kylin 2.3.1 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) With Warm regards Billy Liu
Re: Call for contribution: Kylin Integration with Ambari
I found some discussion and related work in https://issues.apache.org/jira/browse/KYLIN-472. Maybe someone can move on with that. Thanks, Dong Li On 13/03/2018, 08:40, "Billy Liu" <billy...@apache.org> wrote: Hello Kylin dev & user mailer Ambari is quite useful for cluster management, including service start/stop, install/uninstall, monitoring and configuration. Kylin could be an active service managed by Ambari. I know many companies have already deployed Kylin as an Ambari service. This is the call for contribution. If you are interested on cluster management, has skills on python/shell, has experience on Ambari project. You are the right person the community is looking for. Any suggestion is welcomed. With Warm regards Billy Liu
Re: [VOTE] Release apache-kylin-2.3.0 (RC3)
+1 binding mvn test passed md5, gpg, sha checked My environment: Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T15:58:13+08:00) Maven home: /usr/local/Cellar/maven/3.5.2/libexec Java version: 1.8.0_101, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_101.jdk/Contents/Home/jre Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.13.3", arch: "x86_64", family: "mac" Thanks, Dong Li On 02/03/2018, 09:57, "ShaoFeng Shi" <shaofeng...@apache.org> wrote: +1 (binding) Verified signature, md5, sha1; Compile and unit test success on Java 1.8 with MacOS. 2018-03-01 21:33 GMT+08:00 Ge Silas <go...@live.cn>: > +1 > > On 1 Mar 2018, at 2:35 PM, Jianhua Peng <pengjian...@apache.org> wrote: > > +1 > > On 2018/03/01 03:35:31, Billy Liu <billy...@apache.org> wrote: > > Hi all, > > > > Now the known issue has been fixed, and all unit tests and integration > > tests passed. I have created a new build for Apache Kylin 2.3.0, > > release candidate 3. > > > > Changes highlights: > > [KYLIN-2727] - Introduce cube planner able to select cost-effective > > cuboids to be built by cost-based algorithms > > [KYLIN-2726] - Introduce a dashboard for showing kylin service > > related metrics, like query count, query latency, job count, etc > > [KYLIN-3125] - Support SparkSql in Cube building step â?oCreate > > Intermediate Flat Hive Tableâ? > > [KYLIN-3044] - Support SQL Server as data source > > [KYLIN-2960] - Support user/group and role authentication for LDAP > > > > And more than 240 issues fixed. > > > > Thanks to everyone who has contributed to this release. > > Here's release notes: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa? > version=12341685=12316121 > > > > The commit to be voted upon: > > https://github.com/apache/kylin/commit/1179ee72d0a2a2c629a649751ef43a > e9e82dc87a > > > > Its hash is 1179ee72d0a2a2c629a649751ef43ae9e82dc87a > > > > The artifacts to be voted on are located here: > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.0-rc3/ > > > > The hashes of the artifacts are as follows: > > apache-kylin-2.3.0-src.tar.gz.md5 138a96260dc2c8b8f9947b0bcbb11152 > > apache-kylin-2.3.0-src.tar.gz.sha1 b305bb91144d2d1470bd1a8578a111 > 732d04c6f8 > > > > A staged Maven repository is available for review at: > > https://repository.apache.org/content/repositories/orgapachekylin-1048/ > > > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/billyliu.asc > > > > Please vote on releasing this package as Apache Kylin 2.3.0 > > > > The vote is open for the next 72 hours and passes if a majority of at > > least three +1 PPMC votes are cast. > > > > [ ] +1 Release this package as Apache Kylin 2.3.0 > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > Here is my vote: > > > > +1 (binding) > > > > With Warm regards > > > > Billy Liu > > > > -- Best regards, Shaofeng Shi 史少锋
Re: [VOTE] Release apache-kylin-2.3.0 (RC1)
Sorry to change my vote to -1. Just find a critical bug in 2.3.0-rc1 binary package. See https://issues.apache.org/jira/browse/KYLIN-2913 reopened. This will block cube merge and hurt job duration. Thanks, Dong Li On 22/02/2018, 16:40, "Liukaige" <ethe...@gmail.com> wrote: +1 2018-02-22 14:16 GMT+08:00 Jianhua Peng <pengjian...@apache.org>: > +1 binding > > On 2018/02/21 16:10:04, Billy Liu <billy...@apache.org> wrote: > > Hi all, > > > > I have created a build for Apache Kylin 2.3.0, release candidate 1. > > > > Changes highlights: > >[KYLIN-2727] - Introduce cube planner able to select cost-effective > > cuboids to be built by cost-based algorithms > >[KYLIN-2726] - Introduce a dashboard for showing kylin service > > related metrics, like query count, query latency, job count, etc > >[KYLIN-3125] - Support SparkSql in Cube building step “Create > > Intermediate Flat Hive Table” > >[KYLIN-3044] - Support SQL Server as data source > >[KYLIN-2960] - Support user/group and role authentication for LDAP > > > > And more than 240 issues fixed. > > > > Thanks to everyone who has contributed to this release. > > Here's release notes: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa? > version=12341685=12316121 > > > > The commit to be voted upon: > > https://github.com/apache/kylin/commit/cfe632125a6f8bfa043977c5cc657b > b17258c3fe > > > > Its hash is cfe632125a6f8bfa043977c5cc657bb17258c3fe > > > > The artifacts to be voted on are located here: > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.0-rc1/ > > > > The hashes of the artifacts are as follows: > > apache-kylin-2.3.0-src.tar.gz.md5 a640f6c8d58a5ce2bf4262efcf38ee4d > > apache-kylin-2.3.0-src.tar.gz.sha1 f60d9ccabd4e09db9d7799521a6186 > 2a68a37690 > > > > A staged Maven repository is available for review at: > > https://repository.apache.org/content/repositories/orgapachekylin-1046/ > > > > Release artifacts are signed with the following key: > > https://people.apache.org/keys/committer/billyliu.asc > > > > Please vote on releasing this package as Apache Kylin 2.3.0 > > > > The vote is open for the next 72 hours and passes if a majority of at > > least three +1 PPMC votes are cast. > > > > [ ] +1 Release this package as Apache Kylin 2.3.0 > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > [ ] -1 Do not release this package because... > > > > Here is my vote: > > > > +1 (binding) > > > > With Warm regards > > > > Billy Liu > > > -- Best regards, Kaige Liu(刘凯歌) *"Do small things with great love." *
Re: [VOTE] Release apache-kylin-2.3.0 (RC1)
+1 binding mvn test passed md5, gpg, sha checked My environment: Apache Maven 3.5.2 (138edd61fd100ec658bfa2d307c43b76940a5d7d; 2017-10-18T15:58:13+08:00) Maven home: /usr/local/Cellar/maven/3.5.2/libexec Java version: 1.8.0_101, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.8.0_101.jdk/Contents/Home/jre Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.13.3", arch: "x86_64", family: "mac" Thanks, Dong Li On 22/02/2018, 11:45, "ShaoFeng Shi" <shaofeng...@apache.org> wrote: Checked the gpg signature, MD5, LICENSE, README and package size; Compile successfully with java 1.8.0_111 on Mac; +1 (binding) 2018-02-22 0:10 GMT+08:00 Billy Liu <billy...@apache.org>: > Hi all, > > I have created a build for Apache Kylin 2.3.0, release candidate 1. > > Changes highlights: >[KYLIN-2727] - Introduce cube planner able to select cost-effective > cuboids to be built by cost-based algorithms >[KYLIN-2726] - Introduce a dashboard for showing kylin service > related metrics, like query count, query latency, job count, etc >[KYLIN-3125] - Support SparkSql in Cube building step “Create > Intermediate Flat Hive Table” >[KYLIN-3044] - Support SQL Server as data source >[KYLIN-2960] - Support user/group and role authentication for LDAP > > And more than 240 issues fixed. > > Thanks to everyone who has contributed to this release. > Here's release notes: > https://issues.apache.org/jira/secure/ReleaseNote.jspa? > version=12341685=12316121 > > The commit to be voted upon: > https://github.com/apache/kylin/commit/cfe632125a6f8bfa043977c5cc657b > b17258c3fe > > Its hash is cfe632125a6f8bfa043977c5cc657bb17258c3fe > > The artifacts to be voted on are located here: > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.3.0-rc1/ > > The hashes of the artifacts are as follows: > apache-kylin-2.3.0-src.tar.gz.md5 a640f6c8d58a5ce2bf4262efcf38ee4d > apache-kylin-2.3.0-src.tar.gz.sha1 f60d9ccabd4e09db9d7799521a6186 > 2a68a37690 > > A staged Maven repository is available for review at: > https://repository.apache.org/content/repositories/orgapachekylin-1046/ > > Release artifacts are signed with the following key: > https://people.apache.org/keys/committer/billyliu.asc > > Please vote on releasing this package as Apache Kylin 2.3.0 > > The vote is open for the next 72 hours and passes if a majority of at > least three +1 PPMC votes are cast. > > [ ] +1 Release this package as Apache Kylin 2.3.0 > [ ] 0 I don't feel strongly about it, but I'm okay with the release > [ ] -1 Do not release this package because... > > Here is my vote: > > +1 (binding) > > With Warm regards > > Billy Liu > -- Best regards, Shaofeng Shi 史少锋
Re: [Discuss] Apache Kylin Component Owner Plan
+1 No problem. I can continue taking the ownership of ODBC and JDBC components. Maybe I can also be one of the "RDBMS Source <https://issues.apache.org/jira/issues/?jql=project+%3D+KYLIN+AND+component+%3D+%22RDBMS+Source%22>" owners, although it has no issues so far. Thanks, Dong Li 2018-02-03 20:13 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > I would like to take the ownership in "Documentation" and "Streaming" part. > > 2018-02-03 20:11 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > > > Thanks guys; > > > > I have added liyang as one owner of "Metadata", Roger Shi as one owner of > > "Query engine"; How about other committers' preference? > > > > @Jianhua, would you like take the part of "Security" and "Web"? I see you > > have lots of patch in them. > > > > @Dong, will you take the ownership of ODBC and JDBC as before? > > > > @Kaisen, would you like to take over "Storage - HBase" and "Spark > engine"? > > > > @Yerui, @Yanghong, @Cheng, @Qianhao, @Dayue, @Guocheng, @Zhixiong, > > @Xiaoyu, what's your preference? > > > > > > 2018-02-02 23:45 GMT+08:00 Billy Liu <billy...@apache.org>: > > > >> +1 > >> > >> I will set up the code coverage check rule for each PR when the Gitbox > >> migration is done. > >> > >> 2018-02-02 15:34 GMT+08:00 hongbin ma <mahong...@apache.org>: > >> > +1 > >> > > >> > suggest to establish more solid rules on test coverage. I've seen lots > >> > patches without proper tests > >> > > >> > On Fri, Feb 2, 2018 at 2:57 PM, Jianhua Peng <pengjian...@apache.org> > >> wrote: > >> > > >> >> +1 > >> >> > >> >> On 2018/02/02 02:39:38, ShaoFeng Shi <shaofeng...@apache.org> wrote: > >> >> > Hello, Kylin community, > >> >> > > >> >> > In the past, we don't have a clear rule on Kylin each component's > >> >> > ownership, which caused many external patches be pending there as > no > >> >> > reviewer to pick up. > >> >> > > >> >> > Now we plan to make the process and responsibility more clear. The > >> main > >> >> > idea is to identify the owners of each Apache Kylin component. > >> >> > > >> >> > - Component owners will be listed in the description field on this > >> Apache > >> >> > Kylin JIRA components page [1]. The owners are listed in the > >> >> 'Description' > >> >> > field rather than in the 'Component Lead' field because the latter > >> only > >> >> > allows us to list one individual whereas it is encouraged that > >> components > >> >> > have multiple owners. > >> >> > > >> >> > - Component owners are volunteers who are expert in their component > >> >> domain > >> >> > and may have an agenda on how they think their Apache Kylin > component > >> >> > should evolve. The owner needs to be an Apache Kylin committer at > >> this > >> >> > moment. > >> >> > > >> >> > - Owners will try and review patches that land within their > >> component’s > >> >> > scope. > >> >> > > >> >> > - Owners can rotate, based on his aspiration. > >> >> > > >> >> > - When nominate or vote a new committer, the nominator needs to > state > >> >> which > >> >> > component the candidate can be the owner. > >> >> > > >> >> > - If you're already an Apache Kylin committer and would like to be > a > >> >> > volunteer as a component owner, just write to the dev list and > we’ll > >> sign > >> >> > you up. > >> >> > > >> >> > - If you think the component list need be updated (add, remove, > >> rename, > >> >> > etc), write to the dev list and we’ll review that. > >> >> > > >> >> > Below is the component list with old component lead, which assumes > >> to be > >> >> > updated soon. > >> >> > > >> >> > [1] > >> >> > https://issues.apache.org/jira/projects/KYLIN? > >> >> selectedItem=com.atlassian.jira.jira-projects-plugin:components-page > >> >> > > >> >> > Please comment on this plan; if no objection, we will run it for > some > >> >> time > >> >> > to see the effect. Thanks for your inputs! > >> >> > > >> >> > And, thanks to Apache HBase community, from where I learned this. > >> >> > > >> >> > -- > >> >> > Best regards, > >> >> > > >> >> > Shaofeng Shi 史少锋 > >> >> > > >> >> > >> > > >> > > >> > > >> > -- > >> > Regards, > >> > > >> > *Bin Mahone | 马洪宾* > >> > > > > > > > > -- > > Best regards, > > > > Shaofeng Shi 史少锋 > > > > > > > -- > Best regards, > > Shaofeng Shi 史少锋 >
Re: Welcome new Apache Kylin committer: Jianhua Peng
Welcome Jianhua! Thanks, Dong Li 2018-02-02 14:02 GMT+08:00 Luke Han <luke...@apache.org>: > I am very pleased to announce that the Project Management Committee > (PMC) of Apache Kylin has asked Jianhua Peng to becomeApache Kylin > committer, > and he has already accepted. > > Jianhua has already made many contributions to Kylin community, to answer > others questions actively, submit patches for bug fixes and contribute to > some features. We are so glad to have him to be our new committer. > > Please join me to welcome Billy. > > Luke Han > > On behalf of the Apache Kylin PPMC >
Re: [VOTE] Migrate to gitbox
+1 (binding) Sounds very cool! It'll be easier to review code. Thanks, Dong Li 2018-02-01 10:37 GMT+08:00 Billy Liu <billy...@apache.org>: > Hi all, > > I'm starting this vote to migrate Apache Kylin repository from git-wip > to gitbox. Gitbox allows deeper integration with Github, enables > committers to merge, close or edit pull request in Github directly. > > More features: > - Easier for code review compared to the Review Board > - JIRA linking, which will automatically link a PR with its corresponding > JIRA > - Leverage Github ecosystem, such as web hooks for PR monitor, Code > Static Analytics, Coverage Report. > > For Kylin committers, you need to do link your Github account with ASF > account through https://gitbox.apache.org/ > > [ ] +1, Migrate Kylin repository to gitbox > [ ] -1, Keep the current git-wip no change > > > Regards, > Billy Liu >
[Announce] Apache Kylin 2.2.0 released
The Apache Kylin team is pleased to announce the immediate availability of the 2.2.0 release. This is a major release after 2.1, with more than 70 bug fixes and enhancements; All of the changes in this release can be found in: *https://kylin.apache.org/docs21/release_notes.html <https://kylin.apache.org/docs21/release_notes.html>* You can download the source release and binary packages from Apache Kylin's download page: https://kylin.apache.org/download/ Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Apache Hadoop, supporting extremely large datasets. Apache Kylin lets you query massive data set at sub-second latency in 3 steps: 1. Identify a star schema or snowflake schema data set on Hadoop. 2. Build Cube on Hadoop. 3. Query data with ANSI-SQL and get results in sub-second, via ODBC, JDBC or RESTful API. Thanks everyone who have contributed to the 2.2.0 release. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kylin.apache.org/ Thanks, Dong Li
[RESULT][VOTE] Release apache-kylin-2.2.0 (RC1)
I am delighted to announce that the proposal to release Apache Kylin v2.2.0 has passed. The tally is as follows. 4 binding +1s: - Li Yang - Liu Billy - Shi Shaofeng - Li Dong 6 non-binding +1s: - Liu Kaige <kaige@kyligence.io> - Zhang Qi <qi.zh...@kyligence.io> - Tao Jiatao <aron@qq.com> - Kang Kaisen <kangkai...@qq.com> - Liao Shengping <513167...@qq.com> - Yang Hao <yangha...@gmail.com> No 0s or -1s. Thanks, Dong Li 2017-11-02 18:33 GMT+08:00 Qi Zhang <qi.zh...@kyligence.io>: > +1 > > > > On 10/30/17, 9:55 PM, "Dong Li" <lid...@apache.org> wrote: > > Hi all, > > I have created a build for Apache Kylin 2.2.0, release candidate 1. > > Changes highlights: > > KYLIN-2963 - Remove Beta for Spark Cubing > KYLIN-2703 - kylin supports managing ACL through apache ranger. > KYLIN-2761 - Table Level ACL > > And more than 74 issues fixed. > > Thanks to everyone who has contributed to this release. > Here’s release notes: > *https://issues.apache.org/jira/secure/ReleaseNote.jspa? > projectId=12316121=12341139 > <https://issues.apache.org/jira/secure/ReleaseNote.jspa? > projectId=12316121=12341139>* > > The commit to be voted upon: > > *https://github.com/apache/kylin/commit/850c0a6a3b9296d26121f9986701bb > 191921b1bf > <https://github.com/apache/kylin/commit/850c0a6a3b9296d26121f9986701bb > 191921b1bf>* > > Its hash is 850c0a6a3b9296d26121f9986701bb191921b1bf. > > The artifacts to be voted on are located here: > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.2.0-rc1/ > > (The binary packages for HBase 1.x and CDH 5.7 are also provided for > testing) > > The hashes of the artifacts are as follows: > apache-kylin-2.2.0-src.tar.gz.md5 49d166925dd841f6d0333c2a89e66497 > apache-kylin-2.2.0-src.tar.gz.sha1 477cf78734382916537b951b0ebaae > 39122441f3 > > A staged Maven repository is available for review at: > *https://repository.apache.org/content/repositories/ > orgapachekylin-1045 > <https://repository.apache.org/content/repositories/ > orgapachekylin-1045>* > > Release artifacts are signed with the following key: > https://people.apache.org/keys/committer/lidong.asc > > Please vote on releasing this package as Apache Kylin 2.2.0. > > The vote is open for the next 72 hours and passes if a majority of > at least three +1 PPMC votes are cast. > > [ ] +1 Release this package as Apache Kylin 2.2.0 > [ ] 0 I don't feel strongly about it, but I'm okay with the release > [ ] -1 Do not release this package because... > > Here is my vote: > > +1 (binding) > > Thanks, > Dong Li > > > >
[VOTE] Release apache-kylin-2.2.0 (RC1)
Hi all, I have created a build for Apache Kylin 2.2.0, release candidate 1. Changes highlights: KYLIN-2963 - Remove Beta for Spark Cubing KYLIN-2703 - kylin supports managing ACL through apache ranger. KYLIN-2761 - Table Level ACL And more than 74 issues fixed. Thanks to everyone who has contributed to this release. Here’s release notes: *https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12341139 <https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12341139>* The commit to be voted upon: *https://github.com/apache/kylin/commit/850c0a6a3b9296d26121f9986701bb191921b1bf <https://github.com/apache/kylin/commit/850c0a6a3b9296d26121f9986701bb191921b1bf>* Its hash is 850c0a6a3b9296d26121f9986701bb191921b1bf. The artifacts to be voted on are located here: https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.2.0-rc1/ (The binary packages for HBase 1.x and CDH 5.7 are also provided for testing) The hashes of the artifacts are as follows: apache-kylin-2.2.0-src.tar.gz.md5 49d166925dd841f6d0333c2a89e66497 apache-kylin-2.2.0-src.tar.gz.sha1 477cf78734382916537b951b0ebaae39122441f3 A staged Maven repository is available for review at: *https://repository.apache.org/content/repositories/orgapachekylin-1045 <https://repository.apache.org/content/repositories/orgapachekylin-1045>* Release artifacts are signed with the following key: https://people.apache.org/keys/committer/lidong.asc Please vote on releasing this package as Apache Kylin 2.2.0. The vote is open for the next 72 hours and passes if a majority of at least three +1 PPMC votes are cast. [ ] +1 Release this package as Apache Kylin 2.2.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) Thanks, Dong Li
[jira] [Created] (KYLIN-2963) Remove Beta for Spark Cubing
Dong Li created KYLIN-2963: -- Summary: Remove Beta for Spark Cubing Key: KYLIN-2963 URL: https://issues.apache.org/jira/browse/KYLIN-2963 Project: Kylin Issue Type: Improvement Components: Spark Engine Affects Versions: v2.2.0 Reporter: Dong Li We shipped Spark Cubing(Beta) since v2.0 release, and now it's getting stable. More and more users have adopted spark cubing on production environment. It's time to remove the "Beta" label. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: Kylin 2.2.0 release soon
Hello community, The release branch "2.2.x" is out. You can build a package off it and test. http://kylin.apache.org/development/howto_package.html @committers and contributors, please help to check and update your JIRA status. For completed issues, please ensure the status to be Resolved. For unplanned issues, please reset the "fix version" to the real versions. https://issues.apache.org/jira/browse/KYLIN-2915?filter=12333925=project%20%3D%20KYLIN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%20v2.2.0%20ORDER%20BY%20createdDate%20DESC I'll be the Release Manager for this release. If no show stopper is reported, a formal release will be in 2 weeks. Thanks, Dong Li 2017-10-08 14:58 GMT+08:00 Li Yang <liy...@apache.org>: > My major concern is https://issues.apache.org/jira/browse/KYLIN-2918 > > Table ACL is half done at the moment. So either we release the 2.2.0 with a > clear warning of the half done feature. Or we postpone the release till > Table ACL is fully done. > > Any suggestion? > > Yang > > On Wed, Sep 27, 2017 at 5:33 PM, Billy Liu <billy...@apache.org> wrote: > > > Expecting to see the new release. > > > > 2017-09-25 22:20 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > > > > > Cool, when do you plan to kick off the release? > > > > > > 2017-09-25 21:49 GMT+08:00 Li Yang <liy...@apache.org>: > > > > > > > Anything you want to squeeze into the release, it's time. > > > > > > > > > > > > Cheers > > > > Yang > > > > > > > > > > > > > > > > -- > > > Best regards, > > > > > > Shaofeng Shi 史少锋 > > > > > >
[jira] [Created] (KYLIN-2919) Release Kylin 2.2
Dong Li created KYLIN-2919: -- Summary: Release Kylin 2.2 Key: KYLIN-2919 URL: https://issues.apache.org/jira/browse/KYLIN-2919 Project: Kylin Issue Type: Task Reporter: Dong Li -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KYLIN-2868) Include and exclude filters not work on ResourceTool
Dong Li created KYLIN-2868: -- Summary: Include and exclude filters not work on ResourceTool Key: KYLIN-2868 URL: https://issues.apache.org/jira/browse/KYLIN-2868 Project: Kylin Issue Type: Bug Components: Tools, Build and Test Affects Versions: v2.1.0 Reporter: Dong Li Assignee: hongbin ma Priority: Minor We expected not to download /dict and /table_snapshot resources from metastore with command: bin/kylin.sh org.apache.kylin.common.persistence.ResourceTool -Dexclude=/acl,/draft,/scheduler,/user,/execute,/execute_output,/dict,/table_snapshot download /tmp/1505313509126-0 But the downloaded folders are: acl bad_query cube cube_desc cube_statistics dict execute execute_output model_desc project raw_table_desc raw_table_instance table table_snapshot user UUID -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KYLIN-2832) Table meta missing from system diagnosis
Dong Li created KYLIN-2832: -- Summary: Table meta missing from system diagnosis Key: KYLIN-2832 URL: https://issues.apache.org/jira/browse/KYLIN-2832 Project: Kylin Issue Type: Bug Affects Versions: v2.2.0 Reporter: Dong Li -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: kylin2.1 odbc not work
Cool. Thanks for the feedback. Thanks, Dong Li Original Message Sender:apache_dev@163.comapache_...@163.com Recipient:dev...@kylin.apache.org Date:Thursday, Aug 24, 2017 15:06 Subject:Re: kylin2.1 odbc not work This problem have now been sorted, Thinks apache_...@163.com From: apache_...@163.com Date: 2017-08-24 12:11 To: dev Subject: kylin2.1 odbc not work Hi, Env:kylin2.1 HDP2.5.3. odbc2.1 32bit. odbc2.1 set sucess,but can't get any kylin table info from excel. apache_...@163.com
Apache Kylin ODBC Driver 2.1.0 rolled out!
Hello, With Apache Kylin 2.1.0 released in last week, we also built and rolled out new ODBC Driver (v2.1.0) binary packages Here're some hightlight updates: [KYLIN-2558] - ODBC: SQLPrepare(SQLPrepareW) should prepare query metadata [KYLIN-2793] - ODBC Driver - Bypass cert validation when connect to SSL service You can download latest driver installers from download page: http://kylin.apache.org/download/ Any help or feedback are welcomed. For more information on how to report problems, and to get involved, visit the Apache Kylin website at https://kylin.apache.org/ Thanks, Dong Li
[jira] [Created] (KYLIN-2793) ODBC Driver - Bypass cert validation when connect to SSL service
Dong Li created KYLIN-2793: -- Summary: ODBC Driver - Bypass cert validation when connect to SSL service Key: KYLIN-2793 URL: https://issues.apache.org/jira/browse/KYLIN-2793 Project: Kylin Issue Type: Bug Components: Driver - ODBC Affects Versions: v2.0.0 Reporter: Dong Li Some users deploy kylin as internal service with self-signed SSL certification, which will cause connection failure when using ODBC Driver. We can bypass the cert validation in ODBC Driver when connecting kylin service. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
Re: [VOTE] Release apache-kylin-2.1.0 (RC2)
+1 (binding) mvn test passed gpg/md5/sha1 verified Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-11T00:41:47+08:00) Java version: 1.7.0_79, vendor: Oracle Corporation Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.12.6", arch: "x86_64", family: "mac" Thanks, Dong Li 2017-08-13 14:45 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > Hi all, > > I have created a build for Apache Kylin 2.1.0, release candidate 2. > > Changes highlights: > KYLIN-2506 - Refactor global dictionary > KYLIN-2515 - Route unsupported query back to query its source directly > KYLIN-2579 KYLIN-2580 - Improvement on subqueries > KYLIN-2633 - Upgrade Spark to 2.1 > KYLIN-2646 - Project level query authorization > > And more than 100 bug fixes and enhancements. > > Thanks to everyone who has contributed to this release. Here’s release > notes: > https://issues.apache.org/jira/secure/ReleaseNote.jspa?proje > ctId=12316121=12340443 > > The commit to be voted upon: > > https://github.com/apache/kylin/commit/562dd173aaf6b398be8e0 > 53f896755b3afe8137f > > Its hash is 562dd173aaf6b398be8e053f896755b3afe8137f. > > The artifacts to be voted on are located here: > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.1.0-rc2/ > > The hashes of the artifacts are as follows: > apache-kylin-2.1.0-src.tar.gz.md5 44cab3240772dd1b2e717b48105b416c > apache-kylin-2.1.0-src.tar.gz.sha1 a3470589523cfa9046d70123d78059 > b913f31b9f > > (The binary packages for HBase 1.x and CDH 5.7are also provided for > testing) > > A staged Maven repository is available for review at: > https://repository.apache.org/content/repositories/orgapachekylin-1043/ > > Release artifacts are signed with the following key: > https://people.apache.org/keys/committer/shaofengshi.asc > > Please vote on releasing this package as Apache Kylin 2.1.0. > > The vote is open for the next 72 hours and passes if a majority of > at least three +1 PPMC votes are cast. > > [ ] +1 Release this package as Apache Kylin 2.1.0 > [ ] 0 I don't feel strongly about it, but I'm okay with the release > [ ] -1 Do not release this package because... > > Here is my vote: > > +1 (binding) > > > -- > Best regards, > > Shaofeng Shi 史少锋 >
[jira] [Created] (KYLIN-2784) Set User-Agent for ODBC/JDBC Drivers
Dong Li created KYLIN-2784: -- Summary: Set User-Agent for ODBC/JDBC Drivers Key: KYLIN-2784 URL: https://issues.apache.org/jira/browse/KYLIN-2784 Project: Kylin Issue Type: Improvement Components: Driver - JDBC, Driver - ODBC Affects Versions: v2.2.0 Reporter: Dong Li Set specified user-agent for ODBC/JDBC users, so that we can identify http request from drivers in tomcat access logs. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KYLIN-2593) Query with Ton-N by count may fail
Dong Li created KYLIN-2593: -- Summary: Query with Ton-N by count may fail Key: KYLIN-2593 URL: https://issues.apache.org/jira/browse/KYLIN-2593 Project: Kylin Issue Type: Bug Components: Query Engine Reporter: Dong Li Assignee: liyang Stacktrace: ... at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:505) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:956) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:436) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1078) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:625) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:316) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.NullPointerException at org.apache.kylin.metadata.tuple.TupleInfo.getFieldIndex(TupleInfo.java:64) at org.apache.kylin.measure.topn.TopNMeasureType.getAdvancedTupleFiller(TopNMeasureType.java:374) at org.apache.kylin.storage.gtrecord.CubeTupleConverter.(CubeTupleConverter.java:113) at org.apache.kylin.storage.gtrecord.GTCubeStorageQueryBase.newCubeTupleConverter(GTCubeStorageQueryBase.java:159) at org.apache.kylin.storage.gtrecord.SegmentCubeTupleIterator.(SegmentCubeTupleIterator.java:85) at org.apache.kylin.storage.gtrecord.SequentialCubeTupleIterator.(SequentialCubeTupleIterator.java:61) at org.apache.kylin.storage.gtrecord.GTCubeStorageQueryBase.search(GTCubeStorageQueryBase.java:93) at org.apache.kylin.query.enumerator.OLAPEnumerator.queryStorage(OLAPEnumerator.java:120) at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:64) at Baz$1$1.moveNext(Unknown Source) at org.apache.calcite.linq4j.EnumerableDefaults.groupBy_(EnumerableDefaults.java:826) at org.apache.calcite.linq4j.EnumerableDefaults.groupBy(EnumerableDefaults.java:761) at org.apache.calcite.linq4j.DefaultEnumerable.groupBy(DefaultEnumerable.java:302) at Baz.bind(Unknown Source) at org.apache.calcite.jdbc.CalcitePrepare$CalciteSignature.enumerable(CalcitePrepare.java:331) at org.apache.calcite.jdbc.CalciteConnectionImpl.enumerable(CalciteConnectionImpl.java:294) at org.apache.calcite.jdbc.CalciteMetaImpl._createIterable(CalciteMetaImpl.java:553) at org.apache.calcite.jdbc.CalciteMetaImpl.createIterable(CalciteMetaImpl.java:544) at org.apache.calcite.avatica.AvaticaResultSet.execute(AvaticaResultSet.java:193) at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:67) at org.apache.calcite.jdbc.CalciteResultSet.execute(CalciteResultSet.java:44) at org.apache.calcite.avatica.AvaticaConnection$1.execute(AvaticaConnection.java:607) at org.apache.calcite.jdbc.CalciteMetaImpl.prepareAndExecute(CalciteMetaImpl.java:600) at org.apache.calcite.avatica.AvaticaConnection.prepareAndExecuteInternal(AvaticaConnection.java:615) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:148) ... 77 more -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2588) Cannot set two top-n measure of sum in one cube
Dong Li created KYLIN-2588: -- Summary: Cannot set two top-n measure of sum in one cube Key: KYLIN-2588 URL: https://issues.apache.org/jira/browse/KYLIN-2588 Project: Kylin Issue Type: Bug Components: Metadata Affects Versions: v2.0.0 Reporter: Dong Li Assignee: Dong Li NPE will be thrown while query. Caused by: java.lang.NullPointerException at org.apache.kylin.metadata.model.ParameterDesc.equals(ParameterDesc.java:148) at org.apache.kylin.metadata.model.FunctionDesc.equals(FunctionDesc.java:301) at java.util.HashMap.putVal(HashMap.java:634) at java.util.HashMap.put(HashMap.java:611) at org.apache.kylin.cube.gridtable.CuboidToGridTableMapping.init(CuboidToGridTableMapping.java:97) at org.apache.kylin.cube.gridtable.CuboidToGridTableMapping.(CuboidToGridTableMapping.java:60) at org.apache.kylin.cube.gridtable.CubeGridTable.newGTInfo(CubeGridTable.java:27) at org.apache.kylin.storage.gtrecord.CubeScanRangePlanner.(CubeScanRangePlanner.java:89) at org.apache.kylin.storage.gtrecord.CubeSegmentScanner.(CubeSegmentScanner.java:73) at org.apache.kylin.storage.gtrecord.GTCubeStorageQueryBase.search(GTCubeStorageQueryBase.java:86) at org.apache.kylin.query.enumerator.OLAPEnumerator.queryStorage(OLAPEnumerator.java:120) at org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:64) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: [Draft][REPORT] Apache Kylin - May 2017
+1 Thanks, Dong Li Original Message Sender:ShaoFeng shishaofeng...@apache.org Recipient:dev...@kylin.apache.org Cc:Apache Kylin pmcpriv...@kylin.apache.org Date:Thursday, May 4, 2017 13:33 Subject:Re: [Draft][REPORT] Apache Kylin - May 2017 +1 Looks good to me; 2017-05-04 13:25 GMT+08:00 Luke Han luke...@apache.org: Dear community, I have drafted below board report for review, please help to check and let me know if there's any issue. Feel free to reply here if there are more activities, conference, meetup and other events, also community development and others which should be included in this report. Will submit this report to board later. Thanks. Luke ## Description: Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets. ## Issues: - there are no issues requiring board attention at this time ## Activity: - Yang Li presented Apache Kylin 2.0 features at Strata Hadoop World San Jose on 2017-03-16 - Luke Han presented Apache Kylin open source at OSCAR Beijing on 2017-04-19 - Apache Kylin Meetup @Toutiao in Beijing hosted on 2017-04-29 with 200 attendees onsite and 200 online - Chaozhong Yang presented Apache Kylin use case in Toutiao at above Meetup at OSCAR Beijing on 2017-04-19 - Dong Li presented Apache Kylin at OSC China Fujian on 2017-02-25 - Dong Li presented Apache Kylin at OSC China Xiamen on 2017-02-26 - Dong Li presented Apache Kylin at OSC China Wuhan on 2017-04-15 - Dong Li presented Apache Kylin at OSC China Changsha on 2017-04-16 - Hongbin Ma presented Apache Kylin at NJSDGlobal Nanjing on 2017-04-21 - Chen Wang presented Apache Kylin at DBAPlus Meetup China Shanghai on 2017-04-08 - Roger Shi presented Apache Kylin at SQL on Hadoop Meetup Shanghai on 2017-04-29 ## PMC changes: - Currently 18 PMC members. - No new PMC members added in the last 3 months - Last PMC addition was Dong Li on Mon Apr 11 2016 ## Committer base changes: - Currently 28 committers. - New commmitters: - Alberto Ramón was added as a committer on Thu Apr 27 2017 - Zhixiong Chen was added as a committer on Thu Apr 27 2017 - Roger Shi was added as a committer on Thu Apr 27 2017 ## Releases: - 2.0.0 was released on Sat Apr 29 2017 ## Mailing list activity: - dev@kylin.apache.org: - 334 subscribers (up 23 in the last 3 months): - 809 emails sent to list (900 in previous quarter) - iss...@kylin.apache.org: - 61 subscribers (up 9 in the last 3 months): - 923 emails sent to list (1525 in previous quarter) - u...@kylin.apache.org: - 270 subscribers (up 52 in the last 3 months): - 239 emails sent to list (320 in previous quarter) ## JIRA activity: - 164 JIRA tickets created in the last 3 months - 151 JIRA tickets closed/resolved in the last 3 months -- Best regards, Shaofeng Shi 史少锋
[jira] [Created] (KYLIN-2584) Always use embeded spark for spark-cubing
Dong Li created KYLIN-2584: -- Summary: Always use embeded spark for spark-cubing Key: KYLIN-2584 URL: https://issues.apache.org/jira/browse/KYLIN-2584 Project: Kylin Issue Type: Improvement Components: Spark Engine Affects Versions: v2.0.0 Reporter: Dong Li Assignee: Shaofeng SHI We've embeded spark binaries in kylin package since 2.0.0. But still allowed to use other SPARK_HOME defined in environment. If this SPARK version is not comtipable with kylin 2.0, for example, spark 2.0, which affects kylin classpath and block startup of kylin service. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: [Announce] New Apache Kylin committer Alberto Ramón
Welcome! Thanks, Dong Li Original Message Sender:Li yangliy...@apache.org Recipient:privatepriv...@kylin.apache.org Cc:dev...@kylin.apache.org; useru...@kylin.apache.org; alb...@apache.org Date:Saturday, Apr 29, 2017 19:14 Subject:Re: [Announce] New Apache Kylin committer Alberto Ramón Welcome Alberto !! Yang On Sat, Apr 29, 2017 at 6:07 PM, Luke Han luke...@apache.org wrote: On behalf of the Apache Kylin PMC, I am very pleased to announce that Alberto Ramón has accepted the PMC's invitation to become a committer on the project. We appreciate all of Alberto generous contributions about many bug fixes, patches, helped many users. We are so glad to have him to be our new committer and looking forward to his continued involvement. Congratulations and Welcome, Alberto!
Re: [Announce] New Apache Kylin committer Zhixiong Chen
Welcome! Thanks, Dong Li Original Message Sender:Li yangliy...@apache.org Recipient:useru...@kylin.apache.org Cc:dev...@kylin.apache.org; Apache Kylin pmcpriv...@kylin.apache.org; chenc...@apache.org Date:Saturday, Apr 29, 2017 19:13 Subject:Re: [Announce] New Apache Kylin committer Zhixiong Chen Welcome Zhixiong! Yang On Sat, Apr 29, 2017 at 6:07 PM, Luke Han luke...@apache.org wrote: On behalf of theApacheKylin PMC, I am very pleased to announce that Zhixiong Chen has accepted the PMC's invitation to become a committer on the project. We appreciate all of Zhixiong's generous contributions about many bug fixes, patches, helped many users. We are so glad to have him to be our newcommitter and looking forward to his continued involvement. Congratulations and Welcome, Zhixiong!
Re: [Announce] New Apache Kylin committer Roger Shi
Welcome! Thanks, Dong Li Original Message Sender:Li yangliy...@apache.org Recipient:dev...@kylin.apache.org Cc:useru...@kylin.apache.org; Apache Kylin pmcpriv...@kylin.apache.org; sjc...@apache.org Date:Saturday, Apr 29, 2017 19:13 Subject:Re: [Announce] New Apache Kylin committer Roger Shi Welcome Roger! Yang On Sat, Apr 29, 2017 at 6:07 PM, Luke Han luke...@apache.org wrote: On behalf of the Apache Kylin PMC, I am very pleased to announce that Roger Shi has accepted the PMC's invitation to become a committer on the project. We appreciate all of Roger's generous contributions about many bug fixes, patches, helped many users. We are so glad to have him to be our new committer and looking forward to his continued involvement. Congratulations and Welcome, Roger!
Re: [VOTE] Release apache-kylin-2.0.0 (RC3)
+1 binding mvn test passed Thanks, Dong Li 2017-04-28 22:12 GMT+08:00 ShaoFeng Shi <shaofeng...@apache.org>: > +1 binding; > > Verified mvn test, md5, sha1 and gpg signature, all good. > > 2017-04-28 15:11 GMT+08:00 hongbin ma <mahong...@apache.org>: > > > +1 > > > > mvn test passed > > mvn integration test passed > > > > On Thu, Apr 27, 2017 at 8:38 AM, 《秦殇》！健 <yeshic...@foxmail.com> wrote: > > > > > +1 > > > It's great!!! > > > -- 原始邮件 -- > > > 发件人: "Li Yang";<liy...@apache.org>; > > > 发送时间: 2017年4月27日(星期四) 上午7:22 > > > 收件人: "dev"<dev@kylin.apache.org>; > > > > > > 主题: [VOTE] Release apache-kylin-2.0.0 (RC3) > > > > > > > > > > > > Hi all, > > > > > > I have created a build for Apache Kylin 2.0.0, release candidate 3. > > > > > > Changes highlights: > > > > > > Support snowflake data model (KYLIN-1875) > > > Support TPC-H queries (KYLIN-2467) > > > Spark cubing engine (KYLIN-2331) > > > Job engine HA (KYLIN-2006) > > > Percentile measure (KYLIN-2396) > > > Cloud tested (KYLIN-2351) > > > > > > > > > Thanks to everyone who has contributed to this release. Here is release > > > notes: > > > http://kylin.apache.org/docs20/release_notes.html > > > > > > The commit to be voted upon (375fd807c281d8c5deff0620747c80 > 6be2019782): > > > https://github.com/apache/kylin/tree/kylin-2.0.0 > > > > > > The artifacts to be voted on are located here: > > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.0.0-rc3/ > > > > > > A staged Maven repository is available for review at: > > > https://repository.apache.org/content/repositories/ > orgapachekylin-1041/ > > > > > > Release artifacts are signed with the following key: > > > https://people.apache.org/keys/committer/liyang.asc > > > > > > Please vote on releasing this package as Apache Kylin 2.0.0. > > > > > > The vote is open for the next 72 hours and passes if a majority of > > > at least three +1 PPMC votes are cast. > > > > > > [ ] +1 Release this package as Apache Kylin 2.0.0 > > > [ ] 0 I don't feel strongly about it, but I'm okay with the release > > > [ ] -1 Do not release this package because... > > > > > > > > > Here is my vote: > > > > > > +1 (binding) > > > > > > > > > Cheers > > > > > > > > > > > -- > > Regards, > > > > *Bin Mahone | 马洪宾* > > > > > > -- > Best regards, > > Shaofeng Shi 史少锋 >
[jira] [Created] (KYLIN-2571) cannot get real driver.version from kylin jdbc driver
Dong Li created KYLIN-2571: -- Summary: cannot get real driver.version from kylin jdbc driver Key: KYLIN-2571 URL: https://issues.apache.org/jira/browse/KYLIN-2571 Project: Kylin Issue Type: Bug Components: Driver - JDBC Affects Versions: v2.0.0 Reporter: Dong Li Assignee: Dong Li Priority: Minor always return 0.0 from jdbc driver -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: [VOTE] Release apache-kylin-2.0.0 (RC1)
+1 (binding) mvn test passed md5/sha/gpg verified Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-11T00:41:47+08:00) Maven home: /usr/local/Cellar/maven/3.3.9/libexec Java version: 1.7.0_79, vendor: Oracle Corporation Java home: /Library/Java/JavaVirtualMachines/jdk1.7.0_79.jdk/Contents/Home/jre Default locale: en_US, platform encoding: UTF-8 OS name: "mac os x", version: "10.12.4", arch: "x86_64", family: "mac" Thanks, Dong Li 2017-04-22 13:26 GMT+08:00 Li Yang <liy...@apache.org>: > Hi all, > > I have created a build for Apache Kylin 2.0.0, release candidate 1. > > Changes highlights: > > Support snowflake data model (KYLIN-1875) > Support TPC-H queries (KYLIN-2467) > Spark cubing engine (KYLIN-2331) > Job engine HA (KYLIN-2006) > Percentile measure (KYLIN-2396) > Cloud tested (KYLIN-2351) > > > Thanks to everyone who has contributed to this release. Here is release > notes: > http://kylin.apache.org/docs20/release_notes.html > > The commit to be voted upon (199f5db467c224b91c32632fca5e26c4745bdc66): > https://github.com/apache/kylin/tree/kylin-2.0.0 > > The artifacts to be voted on are located here: > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-2.0.0-rc1/ > > A staged Maven repository is available for review at: > https://repository.apache.org/content/repositories/orgapachekylin-1039/ > > Release artifacts are signed with the following key: > https://people.apache.org/keys/committer/liyang.asc > > Please vote on releasing this package as Apache Kylin 2.0.0. > > The vote is open for the next 72 hours and passes if a majority of > at least three +1 PPMC votes are cast. > > [ ] +1 Release this package as Apache Kylin 2.0.0 > [ ] 0 I don't feel strongly about it, but I'm okay with the release > [ ] -1 Do not release this package because... > > > Here is my vote: > > +1 (binding) > > > Cheers > Yang >
[jira] [Created] (KYLIN-2542) Use mvn package instead of mvn install in package scripts
Dong Li created KYLIN-2542: -- Summary: Use mvn package instead of mvn install in package scripts Key: KYLIN-2542 URL: https://issues.apache.org/jira/browse/KYLIN-2542 Project: Kylin Issue Type: Bug Reporter: Dong Li Assignee: Dong Li When we build binary packages for test, we do not need to update local mvn repository. So we can use mvn clean package to replace mvn clean install. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2538) extract(MONTH from CURRENT_DATE) cannot be selected as a column in sql
Dong Li created KYLIN-2538: -- Summary: extract(MONTH from CURRENT_DATE) cannot be selected as a column in sql Key: KYLIN-2538 URL: https://issues.apache.org/jira/browse/KYLIN-2538 Project: Kylin Issue Type: Bug Components: Query Engine Reporter: Dong Li Assignee: liyang This SQL will fail with exceptions: select extract(MONTH from CURRENT_DATE), count(*) from test_kylin_fact Error message: Error while executing SQL "select extract(MONTH from CURRENT_DATE), count(*) from test_kylin_fact LIMIT 5": No TblColRef found in EXTRACT_DATE(FLAG(MONTH), Reinterpret(CURRENT_DATE)) Stacktrace: Caused by: java.lang.IllegalStateException: No TblColRef found in EXTRACT_DATE(FLAG(MONTH), Reinterpret(CURRENT_DATE)) at org.apache.kylin.query.relnode.OLAPProjectRel.buildColumnRowType(OLAPProjectRel.java:132) at org.apache.kylin.query.relnode.OLAPProjectRel.implementOLAP(OLAPProjectRel.java:117) at org.apache.kylin.query.relnode.OLAPRel$OLAPImplementor.visitChild(OLAPRel.java:83) at org.apache.kylin.query.relnode.OLAPLimitRel.implementOLAP(OLAPLimitRel.java:75) at org.apache.kylin.query.relnode.OLAPRel$OLAPImplementor.visitChild(OLAPRel.java:83) at org.apache.kylin.query.relnode.OLAPToEnumerableConverter.implement(OLAPToEnumerableConverter.java:85) at org.apache.calcite.adapter.enumerable.EnumerableRelImplementor.implementRoot(EnumerableRelImplementor.java:108) at org.apache.calcite.adapter.enumerable.EnumerableInterpretable.toBindable(EnumerableInterpretable.java:92) at org.apache.calcite.prepare.CalcitePrepareImpl$CalcitePreparingStmt.implement(CalcitePrepareImpl.java:1248) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:306) at org.apache.calcite.prepare.Prepare.prepareSql(Prepare.java:203) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2529) Allow thread-local override of KylinConfig
Dong Li created KYLIN-2529: -- Summary: Allow thread-local override of KylinConfig Key: KYLIN-2529 URL: https://issues.apache.org/jira/browse/KYLIN-2529 Project: Kylin Issue Type: Improvement Affects Versions: v2.0.0 Reporter: Dong Li Assignee: Dong Li -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2487) IN condition will convert to subquery join when its elements number exceeds 20
Dong Li created KYLIN-2487: -- Summary: IN condition will convert to subquery join when its elements number exceeds 20 Key: KYLIN-2487 URL: https://issues.apache.org/jira/browse/KYLIN-2487 Project: Kylin Issue Type: Bug Components: Query Engine Affects Versions: v1.6.0 Reporter: Dong Li Assignee: Dong Li Priority: Minor In calcite 1.11 which is used in latest master branch, SqlToRelConverter.getInSubqueryThreshold() is marked as deprecated, and its overwrite point won't take effect any more. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2454) Data generation tool will fail if column name is hive reserved keyword
Dong Li created KYLIN-2454: -- Summary: Data generation tool will fail if column name is hive reserved keyword Key: KYLIN-2454 URL: https://issues.apache.org/jira/browse/KYLIN-2454 Project: Kylin Issue Type: Bug Reporter: Dong Li Assignee: Dong Li Priority: Minor Error message: FAILED: ParseException line 3:4 Failed to recognize predicate 'DATE'. Failed rule: 'identifier' in column specification -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: memory leak makes kylin progress be killed?
Hello, Please check this discussion, may be helpful: https://www.mail-archive.com/user@kylin.apache.org/msg01084.html Thanks, Dong Li Original Message Sender:446463844@qq.com446463...@qq.com Recipient:dev...@kylin.apache.org Date:Wednesday, Feb 15, 2017 10:33 Subject:memory leak makes kylin progress be killed? Hi all: I have a question that when I build the cube ,the kylin progress be killed suddenly. then I checked log in kylin's home and found java_pidx.hprof there May memory leak makes kylin progress be killed? 446463...@qq.com
[jira] [Created] (KYLIN-2440) Query failed if join condition columns not appear on cube
Dong Li created KYLIN-2440: -- Summary: Query failed if join condition columns not appear on cube Key: KYLIN-2440 URL: https://issues.apache.org/jira/browse/KYLIN-2440 Project: Kylin Issue Type: Bug Reporter: Dong Li Assignee: liyang The metadata are: The model is: KYLIN_SALES(fact) - KYLIN_ACCOUNT(fact) - KYLIN_COUNTRY(lookup) Dimensions on cube: KYLIN_SALES.PART_DT(Normal), KYLIN_COUNTRY.LONGITUDE(derived) The failed query: SELECT count(*) FROM KYLIN_SALES as KYLIN_SALES INNER JOIN KYLIN_ACCOUNT as KYLIN_ACCOUNT ON KYLIN_SALES.SELLER_ID = KYLIN_ACCOUNT.ACCOUNT_ID INNER JOIN KYLIN_COUNTRY as KYLIN_COUNTRY ON KYLIN_ACCOUNT.ACCOUNT_COUNTRY = KYLIN_COUNTRY.COUNTRY INNER JOIN KYLIN_ACCOUNT as KYLIN_ACCOUNT_B ON KYLIN_SALES.BUYER_ID = KYLIN_ACCOUNT_B.ACCOUNT_ID INNER JOIN KYLIN_COUNTRY as KYLIN_COUNTRY_B ON KYLIN_ACCOUNT_B.ACCOUNT_COUNTRY = KYLIN_COUNTRY_B.COUNTRY Query stacktrace: 2017-02-09 08:49:53,879 ERROR [Query 5a458124-6cae-47b8-8621-24173c1eeba1-101] runtime.CalciteException:59 : org.apache.calcite.sql.validate.SqlValidatorException: Column 'SELLER_ID' not found in ta ble 'KYLIN_SALES' 2017-02-09 08:49:53,880 ERROR [Query 5a458124-6cae-47b8-8621-24173c1eeba1-101] runtime.CalciteException:61 : org.apache.calcite.runtime.CalciteContextException: From line 4, column 16 to line 4, col umn 24: Column 'SELLER_ID' not found in table 'KYLIN_SALES' 2017-02-09 08:49:53,880 ERROR [Query 5a458124-6cae-47b8-8621-24173c1eeba1-101] service.QueryService:379 : Exception when execute sql java.sql.SQLException: Error while executing SQL "SELECT * FROM KYLIN_SALES as KYLIN_SALES INNER JOIN KYLIN_ACCOUNT as KYLIN_ACCOUNT ON KYLIN_SALES.SELLER_ID = KYLIN_ACCOUNT.ACCOUNT_ID INNER JOIN KYLIN_COUNTRY as KYLIN_COUNTRY ON KYLIN_ACCOUNT.ACCOUNT_COUNTRY = KYLIN_COUNTRY.COUNTRY INNER JOIN KYLIN_ACCOUNT as KYLIN_ACCOUNT_B ON KYLIN_SALES.BUYER_ID = KYLIN_ACCOUNT_B.ACCOUNT_ID INNER JOIN KYLIN_COUNTRY as KYLIN_COUNTRY_B ON KYLIN_ACCOUNT_B.ACCOUNT_COUNTRY = KYLIN_COUNTRY_B.COUNTRY LIMIT 5": From line 4, column 16 to line 4, column 24: Column 'SELLER_ID' not found in table 'KYLIN_SALES' at org.apache.calcite.avatica.Helper.createException(Helper.java:56) at org.apache.calcite.avatica.Helper.createException(Helper.java:41) at org.apache.calcite.avatica.AvaticaStatement.executeInternal(AvaticaStatement.java:156) at org.apache.calcite.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:218) at org.apache.kylin.rest.service.QueryService.execute(QueryService.java:557) at org.apache.kylin.rest.service.QueryService.queryWithSqlMassage(QueryService.java:461) Caused by: org.apache.calcite.runtime.CalciteContextException: From line 4, column 16 to line 4, column 24: Column 'SELLER_ID' not found in table 'KYLIN_SALES' at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:463) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:796) at org.apache.calcite.sql.SqlUtil.newContextException(SqlUtil.java:784) at org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError(SqlValidatorImpl.java:4080) at org.apache.calcite.sql.validate.DelegatingScope.fullyQualify(DelegatingScope.java:362) at org.apache.calcite.sql.validate.SqlValidatorImpl$Expander.visit(SqlValidatorImpl.java:4579) at org.apache.calcite.sql.validate.SqlValidatorImpl$Expander.visit(SqlValidatorImpl.java:4561) at org.apache.calcite.sql.SqlIdentifier.accept(SqlIdentifier.java:334) at org.apache.calcite.sql.util.SqlShuttle$CallCopyingArgHandler.visitChild(SqlShuttle.java:134) at org.apache.calcite.sql.util.SqlShuttle$CallCopyingArgHandler.visitChild(SqlShuttle.java:101) Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Column 'SELLER_ID' not found in table 'KYLIN_SALES' at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:526) at org.apache.calcite.runtime.Resources$ExInstWithCause.ex(Resources.java:463) at org.apache.calcite.runtime.Resources$ExInst.ex(Resources.java:572) -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2434) Spark cubing does not respect config kylin.source.hive.database-for-flat-table
Dong Li created KYLIN-2434: -- Summary: Spark cubing does not respect config kylin.source.hive.database-for-flat-table Key: KYLIN-2434 URL: https://issues.apache.org/jira/browse/KYLIN-2434 Project: Kylin Issue Type: Bug Reporter: Dong Li Assignee: Dong Li Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2431) StorageCleanupJob will remove immediate tables created by other kylin instances
Dong Li created KYLIN-2431: -- Summary: StorageCleanupJob will remove immediate tables created by other kylin instances Key: KYLIN-2431 URL: https://issues.apache.org/jira/browse/KYLIN-2431 Project: Kylin Issue Type: Improvement Reporter: Dong Li Assignee: Dong Li Priority: Minor If QA and PROD instances are in same hive database, running StorageCleanupJob on QA will remove immediate tables created by PROD, which might fail Kylin jobs of PROD. A solution is to add metastore name to hive table prefix, then filter table names with metastore name during cleanup job. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
Re: Proposal for updating master branch to use HBase 1.x
+1, thanks Kaige! Thanks, Dong Li 2017-01-23 10:46 GMT+08:00 Luke Han <luke...@gmail.com>: > +1, hope all hbase 0.9x users will upgrade to 1.x soon:) > > Thanks. > > > Best Regards! > - > > Luke Han > > On Sun, Jan 22, 2017 at 12:06 PM, Kaige Liu <kaige@kyligence.io> > wrote: > > > Hi Folks, > > > > Currently our master branch is based on HBase 0.98. As per discussion > here< > > http://apache-kylin.74782.x6.nabble.com/DISCUSS- > > Call-the-next-release-v2-0-td6684.html#a6750>, I think it’s the time to > > change master branch to use HBase 1.x now. > > Below changes should be made: > > > > 1. Delete master-hbase1.x branch and use master branch instead. > > > > 2. merge master-cdh5.7 to master branch(KYLIN-2413<https:// > > issues.apache.org/jira/browse/KYLIN-2413>), master-cdh5.7 should be > > deleted. > > > > 3. new branch master-hbase0.98 will be created to continue > > supporting HBase 0.98. > > > > Users and developers will be impacted and should choose correct branch > > according to corresponding Hadoop distros. > > > > 1. HBase 0.98 users should use master-hbase0.98 branch > > > > 2. Others please use master branch > > > > Developers may need to upgrade your dev environments. > > > > Best regards, > > > > Kaige Liu(刘凯歌) > > Mail: kaige@kyligence.io<mailto:kaige@kyligence.io> > > Shanghai Kyligence Information Technology Co., Ltd > > 上海市浦东新区亮秀路112号Y1座405室 > > > > "Do small things with great love." > > > > >
[jira] [Created] (KYLIN-2413) Use one branch for HBase 1.x and CDH 5.7 binary packages
Dong Li created KYLIN-2413: -- Summary: Use one branch for HBase 1.x and CDH 5.7 binary packages Key: KYLIN-2413 URL: https://issues.apache.org/jira/browse/KYLIN-2413 Project: Kylin Issue Type: New Feature Components: Tools, Build and Test Reporter: Dong Li Assignee: Dong Li Currently the patch for cdh 5.7 contains little production code changes. After we change hbase dependecy to 1.x on master branch, we can also use this branch to generate CDH binary package with specific maven profile. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2396) Percentile pre-aggregation implementation
Dong Li created KYLIN-2396: -- Summary: Percentile pre-aggregation implementation Key: KYLIN-2396 URL: https://issues.apache.org/jira/browse/KYLIN-2396 Project: Kylin Issue Type: Bug Affects Versions: v2.0.0 Reporter: Dong Li Assignee: Dong Li Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: [Announce] New Apache Kylin committer Kaisen Kang
Welcome Kaisen! Thanks, Dong Li Original Message Sender:Jian zhongzhongj...@apache.org Recipient:dev...@kylin.apache.org Date:Monday, Jan 9, 2017 23:07 Subject:Re: [Announce] New Apache Kylin committer Kaisen Kang Welcome! Kaisen On Sat, Jan 7, 2017 at 1:47 PM, Li Yang liy...@apache.org wrote: Welcome, Kaisen~~~ Yang On Wed, Jan 4, 2017 at 3:32 PM, Henry Saputra henry.sapu...@gmail.com wrote:Congrats! Welcome, Kaisen. - Henry On Tue, Jan 3, 2017 at 6:40 PM, 康凯森 kangkai...@qq.com wrote: I am glad and honored to join the Apache Kylin community and will keep contributing to Apache kylin. Thanks for your help and guidance. Wish Apache Kylin better and prosperous. Thank you very much, Luke and our community. -- 原始邮件 --发件人: "Luke Han";luke...@apache.org;发送时间: 2017年1月3日(星期二) 晚上7:12收件人: "dev"dev@kylin.apache.org; "user"u...@kylin.apache.org; "ApacheKylin PMC"priv...@kylin.apache.org; 主题: [Announce] New Apache Kylin committer Kaisen Kang On behalf of the Apache Kylin PMC, I am very pleased to announcethat Kaisen Kang has accepted the PMC's invitation to become a committer on the project. We appreciate all of Kaisen's generous contributions about many bugfixes, patches, helped many users. We are so glad to have him to beour new committer and looking forward to his continued involvement. Congratulations and Welcome, Kaisen!
[jira] [Created] (KYLIN-2313) Cannot find a cube in a subquery case with count distinct
Dong Li created KYLIN-2313: -- Summary: Cannot find a cube in a subquery case with count distinct Key: KYLIN-2313 URL: https://issues.apache.org/jira/browse/KYLIN-2313 Project: Kylin Issue Type: Bug Components: Query Engine Affects Versions: v1.6.0 Reporter: Dong Li Assignee: liyang Priority: Minor With sample cube, The first query can find a cube and give correct result: select p.part_dt, p.lstg_site_id, p.grp, count(distinct user_id), sum(price) from ( select t.part_dt, t.lstg_site_id, t.user_id, t.price, case t.lstg_format_name when 'ABIN' then 'AAA' when 'BBIN' then 'BBB' else 'CCC' end as grp from kylin_sales t) p group by p.part_dt, p.lstg_site_id, p.grp The second query will throw exception: cannot find any realization: select p.part_dt, p.lstg_site_id, p.grp, count(distinct user_id), sum(price) from ( select t.part_dt, t.lstg_site_id, t.user_id, t.price, case t.lstg_format_name when 'ABIN' then 'AAA' when 'BBIN' then 'BBB' else 'CCC' end as grp from kylin_sales t ) p where p.part_dt='2013-01-01' group by p.part_dt, p.lstg_site_id, p.grp Error message: Error while executing SQL "select p.part_dt, p.lstg_site_id, p.grp, count(distinct user_id), sum(price) from ( select t.part_dt, t.lstg_site_id, t.user_id, t.price, case t.lstg_format_name when 'ABIN' then 'AAA' when 'BBIN' then 'BBB' else 'CCC' end as grp from kylin_sales t ) p where p.part_dt='2013-01-01' group by p.part_dt, p.lstg_site_id, p.grp LIMIT 5": Can't find any realization. Please confirm with providers. SQL digest: fact table DEFAULT.KYLIN_SALES,group by [DEFAULT.KYLIN_SALES.PART_DT, DEFAULT.KYLIN_SALES.LSTG_SITE_ID, UNKNOWN_MODEL:DEFAULT._KYLIN_TABLE.GRP],filter on [DEFAULT.KYLIN_SALES.PART_DT],with aggregates[FunctionDesc [expression=COUNT_DISTINCT, parameter=ParameterDesc [type=column, value=USER_ID, nextParam=null], returnType=null], FunctionDesc [expression=SUM, parameter=ParameterDesc [type=column, value=PRICE, nextParam=null], returnType=null]]. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: A question about establishing Kylin
Hello, Seems the root cause is: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.client.HBaseAdmin.(Lorg/apache/hadoop/hbase/client/HConnection;)V Since HBase APIs differ in different versions, Kylin provides 3 binary packages for different hbase versions. Please check your version. If you're using HBase 0.99, please use the binary package for HBase 0.98. http://kylin.apache.org/download/ Thanks, Dong Li 2016-12-05 21:21 GMT+08:00 rockteen <kzrockt...@gmail.com>: > Hi, > > I was trying to setup Kylin on a Hadoop Cluster which is managed by Ambari. > The version of hadoop is 2.6.0, the version of Hive is 0.14.0, the version > of HBase is 0.99.2 and the version of kylin is > apache-kylin-1.5.4.1-bin.tar.gz. > > I could see the "A new Kylin instance is started by root" but then I was > failed to access the web UI, also running sample.sh returned several error > messages.Hive and Hbase shell runs totally well on the server, there are > "kylin_metadata","kylin_metadata_acl","kylin_metadata_user" in the list of > Hbase catagory. I also tested the connection between Hbase and Hive by > creating a mutual table. A lot of solution on Baidu and Google were tested > but the issue remains. Much appreciated if someone can help me on this. > > > 2016-12-05 20:03:05,953 WARN [localhost-startStop-1] > util.HeapMemorySizeUtil:55 : hbase.regionserver.global.memstore.upperLimit > is deprecated by hbase.regionserver.global.memstore.size > 2016-12-05 20:03:06,816 WARN [localhost-startStop-1] > support.XmlWebApplicationContext:487 : Exception encountered during > context > initialization - cancelling refresh attempt: > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name 'mvcContentNegotiationManager': BeanPostProcessor before > instantiation of bean failed; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name 'org.springframework.cache.config.internalCacheAdvisor': Cannot > resolve reference to bean > 'org.springframework.cache.annotation.AnnotationCacheOperationSource#0' > while setting bean property 'cacheOperationSource'; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name > 'org.springframework.cache.annotation.AnnotationCacheOperationSource#0': > BeanPostProcessor before instantiation of bean failed; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name > 'org.springframework.security.methodSecurityMetadataSourceAdvisor': Cannot > resolve reference to bean > 'org.springframework.security.access.method.DelegatingMethodSecurityMetada > taSource#0' > while setting constructor argument; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name > 'org.springframework.security.access.method.DelegatingMethodSecurityMetada > taSource#0': > Cannot create inner bean '(inner bean)#7284f1a1' of type > [org.springframework.security.access.prepost. > PrePostAnnotationSecurityMetadataSource] > while setting constructor argument with key [0]; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name '(inner bean)#7284f1a1': Cannot create inner bean '(inner > bean)#98c3bc5' of type > [org.springframework.security.access.expression.method. > ExpressionBasedAnnotationAttributeFactory] > while setting constructor argument; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name '(inner bean)#98c3bc5': Cannot resolve reference to bean > 'expressionHandler' while setting constructor argument; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name 'expressionHandler' defined in class path resource > [kylinSecurity.xml]: Cannot resolve reference to bean 'permissionEvaluator' > while setting bean property 'permissionEvaluator'; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name 'permissionEvaluator' defined in class path resource > [kylinSecurity.xml]: Cannot resolve reference to bean 'aclService' while > setting constructor argument; nested exception is > org.springframework.beans.factory.BeanCreationException: Error creating > bean > with name 'aclService': Invocation of init method failed; nested exception > is java.lang.NoSuchMethodError: > org.apache.hadoop.hbase.client.HBaseAdmin.(Lorg/ > apache/hadoop/hbase/client/HConnection;)V > Related cause: > org.springframework.beans.factory.BeanCurrentlyInCreationException: Error > creating
Re: Welcome new Apache Kylin committer: Billy Liu
Congrats! Welcome Billy! Thanks, Dong Li Original Message Sender:ShaoFeng shishaofeng...@apache.org Recipient:dev...@kylin.apache.org Date:Wednesday, Nov 30, 2016 09:03 Subject:Re: Welcome new Apache Kylin committer: Billy Liu Welcome Billy! 2016-11-30 8:59 GMT+08:00 Luke Han luke...@apache.org: I am very pleased to announce that the Project Management Committee (PMC) of Apache Kylin has asked Billy (Yiming) Liu to becomeApache Kylin committer, and he has already accepted. Billy has already made many contributions to Kylin community, to answer others questions actively, submit patches for bug fixes and contribute to some features. We are so glad to have him to be our new committer. Please join me to welcome Billy. Luke Han On behalf of the Apache Kylin PPMC -- Best regards, Shaofeng Shi 史少锋
[jira] [Created] (KYLIN-2235) PowerBI get exception "array dimensions exceed supported ranges"
Dong Li created KYLIN-2235: -- Summary: PowerBI get exception "array dimensions exceed supported ranges" Key: KYLIN-2235 URL: https://issues.apache.org/jira/browse/KYLIN-2235 Project: Kylin Issue Type: Bug Components: Driver - ODBC Affects Versions: v1.6.0 Reporter: Dong Li Run SQL: select KYLIN_CATEGORY_GROUPINGS.CATEG_LVL2_NAME from KYLIN_CATEGORY_GROUPINGS Then get exception: "array dimensions exceed supported ranges" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2232) cannot set partition date column pattern when edit a model
Dong Li created KYLIN-2232: -- Summary: cannot set partition date column pattern when edit a model Key: KYLIN-2232 URL: https://issues.apache.org/jira/browse/KYLIN-2232 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v1.5.4.1 Reporter: Dong Li Assignee: Zhong,Jason Priority: Minor See screenshot, there's no entry to update partition date column when edit a model. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: [VOTE] Release apache-kylin-1.6.0 (RC2)
+1 (binding) mvn test passed gpg verified md5 sha1 verified Thanks, Dong Li Original Message Sender:ShaoFeng shishaofeng...@apache.org Recipient:dev...@kylin.apache.org Date:Wednesday, Nov 23, 2016 16:49 Subject:[VOTE] Release apache-kylin-1.6.0 (RC2) Hi all, I have created a build for Apache Kylin 1.6.0, RC2. Thanks to everyone who has contributed to this release. Here’s the release notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121version=1266 Changes highlights: [KYLIN-1726] - Scalable streaming cubing [KYLIN-1917] - TopN merge performance improvement [KYLIN-1919] - Support embedded JSON format [KYLIN-2012] - More robust approach to hive schema changes [KYLIN-2054] - TimedJsonStreamParser support other time format [KYLIN-2055] - Add encoder for Boolean type [KYLIN-2070] - Allow concurrent build/refresh/merge [KYLIN-2082] - Support update streaming configuration The commit to be voted upon: https://github.com/apache/kylin/commit/ed6982c8b3baaad08b7e4956001339979724d9a7 Its hash is ed6982c8b3baaad08b7e4956001339979724d9a7. The artifacts to be voted on are located here: https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.6.0-rc2/ The hashes of the artifacts are as follows: apache-kylin-1.6.0-src.tar.gz.md5 c275593d9a1da5869bcb6f8806de73ba apache-kylin-1.6.0-src.tar.gz.sha1 6c5a895743609c3992e0e75ad32cb6582e6ccad7 A staged Maven repository is available for review at: https://repository.apache.org/content/repositories/orgapachekylin-1038/ Release artifacts are signed with the following key: https://people.apache.org/keys/committer/shaofengshi.asc Please vote on releasing this package as Apache Kylin 1.6.0. The vote is open for the next 72 hours and passes if a majority of at least three +1 PPMC votes are cast. [ ] +1 Release this package as Apache Kylin 1.6.0 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) -- Best regards, Shaofeng Shi 史少锋
[jira] [Created] (KYLIN-2223) Cannot compile a single module
Dong Li created KYLIN-2223: -- Summary: Cannot compile a single module Key: KYLIN-2223 URL: https://issues.apache.org/jira/browse/KYLIN-2223 Project: Kylin Issue Type: Bug Reporter: Dong Li Priority: Minor Compiling a single module will get checkstyle error. For example: cd core-common mvn clean install -DskipTests The result: [INFO] Scanning for projects... [INFO] [INFO] [INFO] Building Apache Kylin - Core Common 1.6.0-SNAPSHOT [INFO] [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ kylin-core-common --- [INFO] Deleting /Projects/kylin/core-common/target [INFO] [INFO] --- maven-checkstyle-plugin:2.17:check (validate) @ kylin-core-common --- [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 1.381 s [INFO] Finished at: 2016-11-23T08:26:03+08:00 [INFO] Final Memory: 14M/309M [INFO] [ERROR] Failed to execute goal org.apache.maven.plugins:maven-checkstyle-plugin:2.17:check (validate) on project kylin-core-common: Failed during checkstyle configuration: cannot initialize module Header - Unable to find: dev-support/checkstyle-apache-header.txt -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: About hybrid model of Kylin
Here’s the document about hybrid: http://kylin.apache.org/blog/2015/09/25/hybrid-model/ Thanks, Dong Li Original Message Sender:仇同心qiutong...@jd.com Recipient:dev@kylin.apache.org...@kylin.apache.org; user@kylin.apache.orgu...@kylin.apache.org Date:Monday, Nov 14, 2016 17:59 Subject:About hybrid model of Kylin Hi ,all When I designed a cube, and have built a period of time, if Iwant to modify the cube dimensions or measurements, It is suggested to use hybrid mode: Create a new cube, and then build back from now;Kylin has a hybrid model, can put the new cube cube and history to make a composite,when queried, can use two cube service together. So , I hope those who know can give me some help. Thanks!
Re: diag.sh fill my hard disk
There’s a bug to causeinfinite loop during job diagnosis(calling diag.sh) in some scenario, which should be the cause of your large logs. It has been fixed in latest 1.6.0 release. Thanks, Dong Li Original Message Sender:446463844@qq.com446463...@qq.com Recipient:dev@kylin.apache.org...@kylin.apache.org Date:Monday, Nov 14, 2016 14:06 Subject:diag.sh fill my hard disk Hi: I run kylin instance in mine test environment.I find that the kylin log increases so fast. and my hard disk is filled so I kill the kylin.sh progress.But it's not stopped. I checkd the machine and find the diag.sh is running. I never start this script. I kill this and it seems OK.why? 446463...@qq.com
Re: [Draft][REPORT] Apache Kylin - Nov 2016
+1 Thanks, Dong Li Original Message Sender:Luke hanluke...@apache.org Recipient:dev...@kylin.apache.org; Apache Kylin pmcpriv...@kylin.apache.org; useru...@kylin.apache.org Date:Friday, Nov 4, 2016 11:49 Subject:[Draft][REPORT] Apache Kylin - Nov 2016 Dear community, I have drafted below board report for review, please help to check and let me know if there's any issue. Feel free to reply here if there are more activities, conference, meetup and other events, also community development and others which should be included in this report. Will submit this report to board later. Thanks. Luke ## Description: === Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets. ## Issues: == - there are no issues requiring board attention at this time ## Activity: - Mailing list, JIRA, and commit activity are at or above average - Apache Kylin Meetup hosted on 2016-10-29 in Shenzhen, China engaged more than 200 participants, with 4 sessions from Liangyi Huang, Jongyoul Li (Zeppelin PMC), WeiShuo Zhen and Yang Li (Kylin PMC) - Yang Li presented Kylin topic at ChinaHadoop live broadcast on 2016-11-3, more than 2200 people joined that session - Luke Han presented Kylin streaming topic at Analysys 10 Summit on 2016-10-28 in Beijing - Luke Han presented Kylin open source topic at QCon Shanghai on 2016-10-22 - *Apache Kylin Practices* eBook published on 2016-10-27 by InfoQ China ## Community: = - Currently 23 PMC members and committers. - No new PMC member committer added in the last 3 months - Messages on the dev mailing list after last report: 720 - Messages on the user mailing list after last report: 402 - 224 JIRA tickets created after last report - 239 JIRA tickets closed/resolved after last report ## Releases: - The latest release, v1.5.4.1, released on 2016-09-28 - v1.5.4, released on 2016-09-15
Re: Unable to pull data from Kylin Cube ( learn_kylin cube ) to Excelor Power BI for Visualization and some dimensions are not showing up.
Thanks Alberto, I created JIRA to track this: https://issues.apache.org/jira/browse/KYLIN-2121 Thanks, Dong Li Original Message Sender:Alberto Ramóna.ramonporto...@gmail.com Recipient:dev...@kylin.apache.org Date:Monday, Oct 24, 2016 20:31 Subject:Re: Unable to pull data from Kylin Cube ( learn_kylin cube ) to Excelor Power BI for Visualization and some dimensions are not showing up. To reproduce, you can use this video https://www.youtube.com/watch?v=v9of5N3TcTwfeature=youtu.be and kylin cube example: select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt (The load data process never will finisfh, as in video, but you can see Error in log "Value was either too large or too small for an Int32" ) 2016-10-23 15:06 GMT+02:00 Luke Han luke...@gmail.com: Please help to create one JIRA for this issue, we will follow up for the root cause and try to fix it if possible. Thanks. Best Regards! - Luke Han On Sat, Oct 22, 2016 at 4:41 AM, Alberto Ramón a.ramonporto...@gmail.com wrote:jeje Yes, The new version of Microsoft Power BI is not working with Kylin . :( See this video https://youtu.be/v9of5N3TcTw mailLIst (you can see ScreenShoots) http://mail-archives.apache.org/mod_mbox/kylin-user/ 201609.mbox/%3CCAEcyM16%3Dd9%2Bdc5equz8pFUowEQg3ntsPm0_Goe% 3DoBBTLKtQg%3DQ%40mail.gmail.com%3E After 3 days testing and view logs, ... I cant solved it I discoverd this: Query with *limit 5*, the preview data run OK, but load data ... never finished 2016-10-21 9:17 GMT+02:00 Bhanu Prakash Sunkesula bps.sunkes...@gmail.com : Hi all, I am unable to load data from KYLIN CUbe to Excel / power BI,i have installed all required drivers ( Microsoft Visual C++ 2012Redistributable http://www.microsoft.com/en-us/download/details.aspx?id=30679 KYLINODBC drivers ). i am able to connect successfully to KYLIN CUBE, but thedata is not loading to excel / power BI because of below issue and alsosome dimensions are not showing up in Excel. Error Message: Value was either too large or too small for an Int32. Stack Trace: Microsoft.Mashup.Evaluator.Interface.ErrorException: Value was either too large or too small for an Int32. --- Microsoft.Mashup.Evaluator. Interface.ErrorException:Value was either too large or too small for an Int32. ---Microsoft.Mashup.Evaluator.Interface.ErrorException: Value was either toolarge or too small for an Int32. --- Microsoft.Mashup.Evaluator. Interface.ErrorException:Value was either too large or too small for an Int32. --- Microsoft.Mashup.Evaluator.Interface.ErrorException: Value was either too large or too small for an Int32. --- System.OverflowException: Value was either too large or too small for an Int32. --- System.OverflowException: Value was either too large or too small for an Int32.at System.Convert.ToInt32(Int64 value)at System.Int64.System.IConvertible.ToInt32(IFormatProvider provider)at System.Convert.ToInt32(Object value, IFormatProvider provider)at Microsoft.Mashup.Engine1.Library.Odbc.OdbcColumnInfoCollection. EnsureInitializedb__0(IOdbcConnection connection)at Microsoft.Mashup.Engine1.Library.Odbc.OdbcDataSource. c__DisplayClassf.Connectb__e(IOdbcConnection connection)at Microsoft.Mashup.Engine1.Library.Odbc.OdbcDataSource. c__DisplayClassc`1.Connectb__b()at Microsoft.Mashup.Engine1.Library.Common.DbExceptionHandler. RunWithRetryGuard[T](Int32maxRetryAttempts, Func`1 action)at Microsoft.Mashup.Engine1.Library.Common.DbExceptionHandler.Invoke[T](Int32 maxRetry, Func`1 action)at Microsoft.Mashup.Engine1.Library.Odbc.OdbcDataSource. Connect[T](String currentCatalog, Func`2 func)at Microsoft.Mashup.Engine1.Library.Odbc.OdbcDataSource. Connect(Action`1 action)at Microsoft.Mashup.Engine1.Library.Odbc.OdbcColumnInfoCollection. EnsureInitialized()at Microsoft.Mashup.Engine1.Library.Odbc.OdbcQueryDomain. NewQuery(OdbcTableInfo table, List`1 fromItems)at Microsoft.Mashup.Engine1.Library.Odbc.OdbcTableValue. OdbcTableValueBuilder.CreateTableValue(OdbcTableInfo tableInfo)at Microsoft.Mashup.Engine1.Library.Odbc. OdbcHierarchicalNavigationTabl eValue.c__DisplayClass9.CreateOdbcTableb__8()at Microsoft.Mashup.Engine1.Runtime.DelayedValue.get_Value()at Microsoft.Mashup.Engine1.Library.Odbc. OdbcHierarchicalNavigationTabl eValue.OdbcTableLevelNavigationTableValue.c__DisplayClass1f. NewLazyRowb__1d(Int32i)at Microsoft.Mashup.Engine1.Runtime.RecordValue. DemandRecordValue.get_Item(Int32 index)at Microsoft.Mashup.Engine1.Runtime.RecordValue.get_Item(String field)at Microsoft.Mashup.Engine1.Language.FieldAccessExpression.Execut
[jira] [Created] (KYLIN-2121) Failed to pull data to PowerBI or Excel on some query
Dong Li created KYLIN-2121: -- Summary: Failed to pull data to PowerBI or Excel on some query Key: KYLIN-2121 URL: https://issues.apache.org/jira/browse/KYLIN-2121 Project: Kylin Issue Type: Bug Components: Driver - ODBC Reporter: Dong Li Priority: Minor select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt (The load data process never will finisfh, as in video, but you can see Error in log "Value was either too large or too small for an Int32" ) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2107) Time delta between first log record and last log record may be larger(around 10ms) than duration field for one query
Dong Li created KYLIN-2107: -- Summary: Time delta between first log record and last log record may be larger(around 10ms) than duration field for one query Key: KYLIN-2107 URL: https://issues.apache.org/jira/browse/KYLIN-2107 Project: Kylin Issue Type: Bug Affects Versions: v1.5.4.1 Reporter: Dong Li Assignee: Dong Li 2016-08-05 02:20:45,672 INFO [http-bio-7070-exec-34] controller.QueryController:174 : Using project: xxx 2016-08-05 02:20:45,672 INFO [http-bio-7070-exec-34] controller.QueryController:175 : The original query: select xxx from xxx 2016-08-05 02:20:45,704 INFO [http-bio-7070-exec-34] routing.QueryRouter:48 : The project manager's reference is org.apache.kylin.metadata.project.ProjectManager@7b58152e 2016-08-05 02:20:45,704 INFO [http-bio-7070-exec-34] routing.QueryRouter:60 : Find candidates by table xxx and project=xxx : org.apache.kylin.query.routing.Candidate@cf6e8c4,org.apache.kylin.query.routing.Candidate@262ba282,org.apache.kylin.query.routing.Candidate@7aba1861,org.apache.kylin.query.routing.Candidate@4f96c739 2016-08-05 02:20:45,705 INFO [http-bio-7070-exec-34] cube.CubeCapabilityChecker:152 : Query joins don't macth on cube xxx 2016-08-05 02:20:45,705 INFO [http-bio-7070-exec-34] cube.CubeCapabilityChecker:58 : Exclude cube xxx because unmatched joins 2016-08-05 02:20:45,705 INFO [http-bio-7070-exec-34] cube.CubeCapabilityChecker:152 : Query joins don't macth on cube 3 2016-08-05 02:20:45,705 INFO [http-bio-7070-exec-34] cube.CubeCapabilityChecker:58 : Exclude cube 3 because unmatched joins 2016-08-05 02:20:45,706 INFO [http-bio-7070-exec-34] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RemoveUncapableRealizationsRule, realizations before: [xxx] 2016-08-05 02:20:45,706 INFO [http-bio-7070-exec-34] routing.QueryRouter:49 : Applying rule: class org.apache.kylin.query.routing.rules.RealizationSortRule, realizations before: [xxx], realizations after: [xxx] 2016-08-05 02:20:45,706 INFO [http-bio-7070-exec-34] routing.QueryRouter:72 : The realizations remaining: [xxx] And the final chosen one is the first one 2016-08-05 02:20:45,732 DEBUG [http-bio-7070-exec-34] enumerator.OLAPEnumerator:105 : query storage... 2016-08-05 02:20:45,733 INFO [http-bio-7070-exec-34] gtrecord.GTCubeStorageQueryBase:242 : exactAggregation is false because cube is partitioned and xxx is not on group by 2016-08-05 02:20:45,733 DEBUG [http-bio-7070-exec-34] v2.CubeHBaseEndpointRPC:268 : New scanner for current segment xxx[xxx] will use SCAN_FILTER_AGGR_CHECKMEM as endpoint's behavior 2016-08-05 02:20:45,734 DEBUG [http-bio-7070-exec-34] v2.CubeHBaseEndpointRPC:324 : Serialized scanRequestBytes 563 bytes, rawScanBytesString 46 bytes 2016-08-05 02:20:45,734 INFO [http-bio-7070-exec-34] v2.CubeHBaseEndpointRPC:326 : The scan 3bdc81c0 for segment xx[xxx] is as below with 1 separate raw scans, shard part of start/end key is set to 0 2016-08-05 02:20:45,735 INFO [http-bio-7070-exec-34] v2.CubeHBaseRPC:271 : Visiting hbase table xxx: cuboid exact match, from 64 to 112 Start: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x70\x00\x00\x00\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00p\x00\x00\x00\x00) Stop: \x00\x00\x00\x00\x00\x00\x00\x00\x00\x70\xFF\xFF\xFF\xFF\x00 (\x00\x00\x00\x00\x00\x00\x00\x00\x00p\xFF\xFF\xFF\xFF\x00), No Fuzzy Key 2016-08-05 02:20:45,735 DEBUG [http-bio-7070-exec-34] v2.CubeHBaseEndpointRPC:331 : Submitting rpc to 1 shards starting from shard 4, scan range count 1 2016-08-05 02:20:45,735 INFO [http-bio-7070-exec-34] v2.CubeHBaseEndpointRPC:107 : Timeout for ExpectedSizeIterator is: 33 2016-08-05 02:20:45,735 DEBUG [http-bio-7070-exec-34] enumerator.OLAPEnumerator:122 : return TupleIterator... 2016-08-05 02:20:45,785 INFO [kylin-coproc--pool8-t191] v2.CubeHBaseEndpointRPC:385 : Endpoint RPC returned from HTable KYLIN_Y8T1367HP7 Shard \x4B\x59\x4C\x49\x4E\x5F\x59\x38\x54\x31\x33\x36\x37\x48\x50\x37\x2C\x00\x04\x2C\x31\x34\x37\x30\x30\x34\x34\x33\x39\x38\x36\x38\x35\x2E\x34\x34\x63\x31\x61\x39\x30\x62\x65\x66\x65\x36\x34\x36\x38\x33\x37\x65\x36\x34\x61\x34\x61\x61\x32\x61\x31\x64\x37\x38\x66\x62\x2E on host: ip-10-0-0-207.Total scanned row: 7525. Total filtered/aggred row: 0. Time elapsed in EP: 45(ms). Server CPU usage: 0.054019367635048415, server physical mem left: 8.3144704E7, server swap mem left:5.612847104E9.Etc message: start latency: -1745@1,agg done@40,compress done@44,server stats done@45, debugGitTag:7acf71b130d3d11852c392890f5bf5b62b251523@KAP;297c46858e11ba7875671a4d39b46d90a5b2548a@ApacheKylin;Build with JENKINS at 2016-08-02 00:04:20;.Normal Complete: true. 2016-08-05 02:20:45,786 DEBUG [kylin-coproc--pool8-t191] util.CompressionUtils:67 : Original: 53084 bytes. Decompressed: 60200 bytes. Time: 1 2016-08-05 02:20:45,805 INFO [http-bio-7070-exec-34
Re: [VOTE] Release apache-kylin-1.5.4.1 (release candidate 1)
-1 Found CURRENT_KYLIN_VERSION not updated in KylinVersion.java. Thanks, Dong Li Original Message Sender:ShaoFeng shishaofeng...@apache.org Recipient:dev...@kylin.apache.org Date:Saturday, Sep 24, 2016 08:47 Subject:[VOTE] Release apache-kylin-1.5.4.1 (release candidate 1) Hi all, I have created a build for Apache Kylin 1.5.4.1, release candidate 1. Changes: [KYLIN-2026] - NPE occurs when build a cube without partition column [KYLIN-2032] - Cube build failed when partition column isn't in dimension list Thanks to everyone who has contributed to this release. Here’s release notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121version=12338305 The commit to be voted upon: https://github.com/apache/kylin/commit/b08871e7dd4595474832b5b6a2e156935b2d73c6 Its hash is b08871e7dd4595474832b5b6a2e156935b2d73c6. The artifacts to be voted on are located here: https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.4.1-rc1/ The hashes of the artifacts are as follows: apache-kylin-1.5.4.1-src.tar.gz.md5 04f5b6b99c662834b4728d4905e4f833 apache-kylin-1.5.4.1-src.tar.gz.sha1 df4158e0e5867a78a34f2afe1fe0f312238222d4 A staged Maven repository is available for review at: https://repository.apache.org/content/repositories/orgapachekylin-1035/ Release artifacts are signed with the following key: https://people.apache.org/keys/committer/shaofengshi.asc Please vote on releasing this package as Apache Kylin 1.5.4.1. The vote is open for the next 72 hours and passes if a majority of at least three +1 PPMC votes are cast. [ ] +1 Release this package as Apache Kylin 1.5.4.1 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) -- Best regards, Shaofeng Shi 史少锋
Re: [Award] Kylin won InfoWord Bossie Awards 2016, again!
Cheers! Thanks, Dong Li Original Message Sender:ShaoFeng shishaofeng...@apache.org Recipient:dev...@kylin.apache.org Date:Friday, Sep 23, 2016 09:34 Subject:Re: [Award] Kylin won InfoWord Bossie Awards 2016, again! Wow, so exited to see this; Congratulations to all the developers and users! 2016-09-23 1:20 GMT+08:00 Henry Saputra henry.sapu...@gmail.com: Congrats, guys! - Henry On Thu, Sep 22, 2016 at 9:35 AM, Luke Han luke...@apache.org wrote:Hi community, You may already know, in the latest announced news from InfoWorld, Apache Kylin has been selected for this year's Bossie Awards again: *The Best Open Source Big Data Tools*. This is second time we won this. There are 12 projects in this years list, they are TensorFlow, Beam, Spark, Kylin Kafka,Impala, Elasticsearch, SlamData, Zeppelin, Solr, Streamsets, Titan. Most of them are Apache projects (include incubating). Congrats to ASF! Would like to take this monument to say thanks to everybody, we never could won such industry recognition without everyone's contribution, thanks:-) Here's news link, enjoy it: http://www.infoworld.com/article/3120856/open-source- tools/bossie-awards-2016-the-best-open-source-big-data-tools.html#slide9 Thanks. Luke Han-- Best regards, Shaofeng Shi 史少锋
Re: [VOTE] Release apache-kylin-1.5.4 (release candidate 1)
+1 (binding) mvn test passed gpg verify passed md5/sha1 verify passed Thanks, Dong Li Original Message Sender:ShaoFeng shishaofeng...@apache.org Recipient:dev...@kylin.apache.org Date:Sunday, Sep 11, 2016 19:40 Subject:[VOTE] Release apache-kylin-1.5.4 (release candidate 1) Hi all, I have created a build for Apache Kylin 1.5.4, release candidate 1. Changes highlights: [KYLIN-1732] - Support Window Function [KYLIN-1767] - UI for TopN: specify encoding and multiple "group by" [KYLIN-1834] - java.lang.IllegalArgumentException: Value not exists! - in Step 4 - Build Dimension Dictionary [KYLIN-1898] - Upgrade to Avatica 1.8 [KYLIN-1904] - WebUI for GlobalDictionary [KYLIN-1908] - Collect Metrics to JMX [KYLIN-1934] - 'Value not exist' During Cube Merging Caused by Empty Dict Thanks to everyone who has contributed to this release. Here’s release notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121version=12338015 The commit to be voted upon: https://github.com/apache/kylin/commit/519b93b539c31582f20c5f308dbd7b9f2e6814b9 Its hash is 519b93b539c31582f20c5f308dbd7b9f2e6814b9. The artifacts to be voted on are located here: https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.4-rc1/ The hashes of the artifacts are as follows: apache-kylin-1.5.4-src.tar.gz.md5 e477fc69d642fd633b80239088f66eed apache-kylin-1.5.4-src.tar.gz.sha1 e1226c02cca15b4b8fdbfeb8c659b3740e6ad34e A staged Maven repository is available for review at: https://repository.apache.org/content/repositories/orgapachekylin-1034/ Release artifacts are signed with the following key: https://people.apache.org/keys/committer/shaofengshi.asc Please vote on releasing this package as Apache Kylin 1.5.4. The vote is open for the next 72 hours and passes if a majority of at least three +1 PMC votes are cast. [ ] +1 Release this package as Apache Kylin 1.5.4 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) -- Best regards, Shaofeng Shi
[jira] [Created] (KYLIN-1953) Error handling for diagnosis
Dong Li created KYLIN-1953: -- Summary: Error handling for diagnosis Key: KYLIN-1953 URL: https://issues.apache.org/jira/browse/KYLIN-1953 Project: Kylin Issue Type: Bug Affects Versions: v1.5.3 Reporter: Dong Li Assignee: Dong Li Currently exceptions from diagnosis may not write to log files. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1909) Wrong access control to rest get cubes
Dong Li created KYLIN-1909: -- Summary: Wrong access control to rest get cubes Key: KYLIN-1909 URL: https://issues.apache.org/jira/browse/KYLIN-1909 Project: Kylin Issue Type: Bug Components: REST Service Affects Versions: v1.5.2 Reporter: Dong Li Assignee: Zhong,Jason Priority: Minor 1. Import sample data 2. Login with user: ANALYST, see nothing 3. Request rest api: http://sandbox:7070/kylin/api/cubes?limit=15=0=learn_kylin Then found the list of cubes. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1879) RestAPI /api/jobs always returns 0 for exec_start_time and exec_end_time fields
Dong Li created KYLIN-1879: -- Summary: RestAPI /api/jobs always returns 0 for exec_start_time and exec_end_time fields Key: KYLIN-1879 URL: https://issues.apache.org/jira/browse/KYLIN-1879 Project: Kylin Issue Type: Bug Components: REST Service Affects Versions: v1.5.2 Reporter: Dong Li Assignee: Dong Li Priority: Minor URL: http://sandbox:7070/kylin/api/jobs?limit=15=0=learn_kylin=1 submitter: "ADMIN", progress: 100, last_modified: 1468318063053, related_cube: "kylin_sales_cube", related_segment: "2955247b-5fe3-4225-807f-f2fd32bab73d", exec_start_time: 0, exec_end_time: 0, mr_waiting: 114, job_status: "FINISHED" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1817) No result from JDBC with Date filter in prepareStatement
Dong Li created KYLIN-1817:
--
Summary: No result from JDBC with Date filter in prepareStatement
Key: KYLIN-1817
URL: https://issues.apache.org/jira/browse/KYLIN-1817
Project: Kylin
Issue Type: Bug
Components: Driver - JDBC
Reporter: Dong Li
Priority: Minor
>From Qiu Tongxin:
大家好：
用kylin的JDBC查询，查询条件是date类型的，但是查询不出数据，以下是代码：
driver = (Driver)
Class.forName("org.apache.kylin.jdbc.Driver").newInstance();
Properties info = new Properties();
info.put("user", "ADMIN");
info.put("password", "KYLIN");
conn = driver.connect("jdbc:kylin://IP:7070/learn_kylin", info);
（此处IP代替了真实IP地址）
state = conn.prepareStatement("select * from KYLIN_SALES where
part_dt = ?");
SimpleDateFormat simpleTime = new SimpleDateFormat("-MM-dd");
java.util.Date passUtilDate = simpleTime.parse("2013-01-01");
java.sql.Date passSqlDate = new
java.sql.Date(passUtilDate.getTime());
System.out.println("passSqlDate>"+passSqlDate);
state.setDate(1, passSqlDate);
resultSet = state.executeQuery();
控制台日志为：
passSqlDate>2013-01-01
2016-06-23 14:19:52,591 DEBUG [main] jdbc.KylinClient:341 : Post body:
{"sql":"select * from KYLIN_SALES where part_dt =
?","project":"learn_kylin","acceptPartial":false,"params":[{"className":"java.lang.Integer","value":"15706"}]}
2016-06-23 14:19:52,592 DEBUG [main] wire.content:84 : <<
"{"userDetails":{"password":null,"username":"ADMIN","authorities":[{"authority":"ROLE_ADMIN"},{"authority":"ROLE_ANALYST"},{"authority":"ROLE_MODELER"}],"accountNonExpired":true,"accountNonLocked":true,"credentialsNonExpired":true,"enabled":true}}"
为什么kylin把传进的参数转为了"params":[{"className":"java.lang.Integer","value":"15706"}]？？？
>From Bhanu Mohanty:
Issues with Kylin PreparedStatement
Data Type : Date
// From Date
PreparedStatement.setDate(1, java.sql.Date.valueOf("2016-01-01"));
// To Date
PreparedStatement.setDate(2, java.sql.Date.valueOf("2016-06-01"));
Kylin Debug Statement - Post body:
{"sql":"","project":"***","acceptPartial":false,"params":[{"className":"java.lang.Integer","value":"16801"},{"className":"java.lang.Integer","value":"16953"}]}
No data is returned.
If I pass the date part of the Query String , then it returns data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (KYLIN-1814) Avoid "catch-log-throw" pattern in source code
Dong Li created KYLIN-1814:
--
Summary: Avoid "catch-log-throw" pattern in source code
Key: KYLIN-1814
URL: https://issues.apache.org/jira/browse/KYLIN-1814
Project: Kylin
Issue Type: Improvement
Affects Versions: v1.5.2
Reporter: Dong Li
Assignee: Dong Li
Priority: Minor
"catch-log-throw" will make log messages mess, and we need to go through all
code and fix them. For example, In CubeController class:
private JobInstance buildInternal(String cubeName, long startTime, long
endTime, //
long startOffset, long endOffset, String buildType, boolean force) {
try {
String submitter =
SecurityContextHolder.getContext().getAuthentication().getName();
CubeInstance cube = jobService.getCubeManager().getCube(cubeName);
return jobService.submitJob(cube, startTime, endTime, startOffset,
endOffset, //
CubeBuildTypeEnum.valueOf(buildType), force, submitter);
} catch (Exception e) {
logger.error(e.getLocalizedMessage(), e);
throw new InternalErrorException(e.getLocalizedMessage());
}
}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (KYLIN-1786) Frontend work for KYLIN-1313
Dong Li created KYLIN-1786: -- Summary: Frontend work for KYLIN-1313 Key: KYLIN-1786 URL: https://issues.apache.org/jira/browse/KYLIN-1786 Project: Kylin Issue Type: Improvement Components: Web Reporter: Dong Li Assignee: Zhong,Jason Priority: Minor Attachments: 屏幕快照 2016-06-15 12.22.54.png KYLIN-1313 introduced a measure called extendedcolumn, but seems not enabled on WebUI, see attached screenshot. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: id-name
Are these dimensions on Lookup tables or Fact table? If lookup tables, you could use derived dimension. If fact table, would they both become filter? If yes, you can use joint aggragation group; if not, you may use ExtendedColumn measure. But this measure are not enabled on WebUI currently, I remembered a JIRA(KYLIN-1313) about this, but I cannot access JIRA at this moment, you can have a look if needed. Thanks, Dong Li 2016-06-15 10:23 GMT+08:00 yu feng <olaptes...@gmail.com>: > derived dimension is a better choice. > > 2016-06-14 23:00 GMT+08:00 耳东 <775620...@qq.com>: > > > hi allwhen I build the cube, there are always dimension like > > (city_id,city_name) or (terminal_id,terminal_name) and so on, which is > one > > to one relation. I don't want to let both id and name be dimension. How > can > > I make name a measure other than a dimension? >
Re: Timeout visiting cube
There should be more exceptions which telling the root-cause before the TimeoutVisitingCube exception. Like Hongbin said, could you please provided more information? Thanks, Dong Li 2016-06-15 9:11 GMT+08:00 Jiaojiao Li <jia...@microsoft.com>: > Gentle ping... > > -Original Message- > From: Jiaojiao Li [mailto:jia...@microsoft.com] > Sent: Tuesday, June 14, 2016 4:51 PM > To: dev@kylin.apache.org > Cc: shaofeng...@apache.org > Subject: Timeout visiting cube > > > Hi Kylin experts, > > Error happens when perform query, query is like this *select > count(distinct userid) from XXX LIMIT 5*. > > > > Caused by: java.lang.RuntimeException: Timeout visiting cube! > > More detailed stack trace shows: > > at > org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:127) > > at > org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC$ExpectedSizeIterator.next(CubeHBaseEndpointRPC.java:81) > > at > com.google.common.collect.TransformedIterator.next(TransformedIterator.java:48) > > at > com.google.common.collect.Iterators$6.hasNext(Iterators.java:583) > > at > org.apache.kylin.storage.hbase.cube.v2.SequentialCubeTupleIterator.hasNext(SequentialCubeTupleIterator.java:96) > > at > org.apache.kylin.query.enumerator.OLAPEnumerator.moveNext(OLAPEnumerator.java:74) > > > > I have increased the *kylin.query.cube.visit.timeout.times* to 10. However > it still suffers from hbase rpc timeout. > > Do you have idea on how to solve this problem? > > > > Kylin: 1.5.2 > > HBase: 1.1.2.2.3.4.7-4 > > Hadoop: 2.7.1.2.3.4.7-4 > > > > Thanks a lot! > >
Re: Not a valid JAR
Hi, A better way is to use build/script/package.sh to build your own tar package. The kylin-job-*.jar under $KYLIN_HOME/lib folder comes from assembly/target/kylin-assembly-*-job.jar, rather than core-job/target/kyin-core-job-*.jar. Thanks, Dong Li 2016-06-14 22:06 GMT+08:00 TTS2沉默天使 <85546...@qq.com>: > sample.sh > Sample hive tables are created successfully; Going to create sample cube... > Not a valid JAR: > /usr/local/other/apache-kylin-1.5.2-bin/org.apache.kylin.common.persistence.ResourceTool > > > > 1.pom的hbase版本变更为1.2.1 > 2.将编译过的jar包替换lib下的jar > kylin-core-job-1.5.2.1.jar kylin-storage-hbase-1.5.2.1-coprocessor.jar > kylin-jdbc-1.5.2.1.jar > > 3.运行bin下的sample.sh <http://3.xn--binsample-2b6nt576atuybvou.sh> 报如上问题
回复： mvn install error
Have you installed multiple JDK? And do you have JRE6 in your environment. build_cube_with_engine is for test. If you don’t need test, you can add “-skipTests” to mvn command. Thanks, Dong Original Message Sender:TTS2沉默天使85546...@qq.com Recipient:dev...@kylin.apache.org Date:Monday, Jun 13, 2016 18:17 Subject:回复： mvn install error (build_cube_with_engine)说这个编译错误 我又不知道这是什么-- 原始邮件 -- 发件人: "85546017"85546...@qq.com 发送时间: 2016年6月13日(星期一) 晚上6:11 收件人: "dev"dev@kylin.apache.org; 主题: 回复： mvn install error 我编译的环境是jdk1.7的-- 原始邮#x4EF6; -- 发#x4EF6;人: "Li Yang"liy...@apache.org 发送时间: 2016年6月13日(星期一) 下午5:13 收#x4EF6;人: "dev"dev@kylin.apache.org; 主题: Re: mvn install error Kylin requires JDK 7. Seems you are on JDK 6. On Sat, Jun 11, 2016 at 11:43 AM, TTS2沉默天使 85546...@qq.com wrote: [INFO] --- exec-maven-plugin:1.4.0:exec (build_cube_with_engine) @ kylin-it --- Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/kylin/provision/BuildCubeWithEngine : Unsupported major.minor version 51.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:643) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:277) at java.net.URLClassLoader.access$000(URLClassLoader.java:73) at java.net.URLClassLoader$1.run(URLClassLoader.java:212) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:205) at java.lang.ClassLoader.loadClass(ClassLoader.java:323) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) at java.lang.ClassLoader.loadClass(ClassLoader.java:268) Could not find the main class: org.apache.kylin.provision.BuildCubeWithEngine. Program will exit. [INFO] [INFO] BUILD FAILURE [INFO] [INFO] Total time: 01:34 min [INFO] Finished at: 2016-06-11T11:22:50+08:00 [INFO] Final Memory: 39M/372M [INFO] [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.4.0:exec (build_cube_with_engine) on project kylin-it: Command execution failed. Process exited with an error: 1 (Exit value: 1) - [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException -- 原始邮#x4EF6; -- 发#x4EF6;人: "TTS2沉默天使";85546...@qq.com; 发送时间: 2016年6月11日(星期六) 中午11:42 收#x4EF6;人: "dev"dev@kylin.apache.org; 主题: mvn install error Kylin-it:Mvn install error POM:hbase-hadoop2.version1.2.1/hbase-hadoop2.version
Blog to introduce the Diagnosis Tool
Hello community, I wrote a blog about the Diagnosis functionality introduced since 1.5.2. http://kylin.apache.org/blog/2016/06/10/diagnosis-tool/ Please have a view if you need it. Thanks, Dong
[jira] [Created] (KYLIN-1778) Timeout handling for Query on WebUI
Dong Li created KYLIN-1778: -- Summary: Timeout handling for Query on WebUI Key: KYLIN-1778 URL: https://issues.apache.org/jira/browse/KYLIN-1778 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v1.5.2 Reporter: Dong Li Assignee: Zhong,Jason Priority: Minor In this js file: webapp/app/js/services/query.js, we find the timeout is hard coded as 300s for query. When user's query exceed this limitation, the query directly failed with no messages, but may found it succeeded in logs several minutes later. Solution options: 1. Make the timeout limitation configurable 2. Prompt timeout message to user -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1773) Model should not be editable if used by cubes
Dong Li created KYLIN-1773: -- Summary: Model should not be editable if used by cubes Key: KYLIN-1773 URL: https://issues.apache.org/jira/browse/KYLIN-1773 Project: Kylin Issue Type: Bug Affects Versions: v1.5.2 Reporter: Dong Li Assignee: Dong Li Priority: Minor With sample data 1. build cube kylin_sales_cube. 2. edit model kylin_sales_model 3. change fact table to other tables 4. save Actual: model saved, and cube/model loading will fail Expect: Model cannot be saved, with warn message like "Cannot edit model because there's cube references." -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1741) Enhance diagnosis tool
Dong Li created KYLIN-1741: -- Summary: Enhance diagnosis tool Key: KYLIN-1741 URL: https://issues.apache.org/jira/browse/KYLIN-1741 Project: Kylin Issue Type: Improvement Components: Tools, Build and Test Reporter: Dong Li Assignee: Dong Li Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[ANNOUNCE] Apache Kylin 1.5.2 released
The Apache Kylin team is pleased to announce the immediate availability of the 1.5.2 release. The release note can be found here [1]; The source code and binary package can be downloaded from Kylin's download page [2]. The Apache Kylin Team would like to hear from you and welcomes your comments and contributions. Thanks, The Apache Kylin Team [1] https://kylin.apache.org/docs15/release_notes.html [2] https://kylin.apache.org/download/
[RESULT] [VOTE] Release apache-kylin-1.5.2 (release candidate 3)
Thanks to everyone who has tested the release candidate and given their comments and votes. The tally is as follows. 6 binding +1s: Dong Li Luke Han Yang Li Shaofeng Shi Jason Zhong Xiaoyu Wang 2 non-binding +1s: Meng Liang Roger Shi No 0s or -1s. Therefore I am delighted to announce that the proposal to release apache-kylin-1.5.2 has passed. Dong Li
[jira] [Created] (KYLIN-1738) MRJob Id is not saved to kylin jobs if MR job is killed
Dong Li created KYLIN-1738: -- Summary: MRJob Id is not saved to kylin jobs if MR job is killed Key: KYLIN-1738 URL: https://issues.apache.org/jira/browse/KYLIN-1738 Project: Kylin Issue Type: Bug Components: Job Engine Affects Versions: v1.5.1 Reporter: Dong Li Assignee: Dong Li Priority: Minor A kylin job failed with message: killed by admin, and cannot find mr job id. Go through job history server, found the mr job got killed with: MAP capability required is more than the supported max container capability in the cluster. Killing the Job. mapResourceRequest: <memory:3072, vCores:1> maxContainerCapability:<memory:2250, vCores:32> Job received Kill while in RUNNING state. We should save the JobId for diagnosis when job status is killed like failed/finished. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[VOTE] Release apache-kylin-1.5.2 (release candidate 3)
Hi all, I have created a build for Apache Kylin 1.5.2, release candidate 3. Changes highlights: - [KYLIN-1077] - Support Hive View as Lookup Table - [KYLIN-1515] - Make Kylin run on MapR - [KYLIN-1600] - Download diagnosis zip from GUI - [KYLIN-1672] - support kylin on cdh 5.7 Thanks to everyone who has contributed to this release. Here’s release notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12335528 The commit to be voted upon: *https://github.com/apache/kylin/commit/af2646b72fbb6dc81699ad6661303fd612a2eebf <https://github.com/apache/kylin/commit/af2646b72fbb6dc81699ad6661303fd612a2eebf>* Its hash is af2646b72fbb6dc81699ad6661303fd612a2eebf. The artifacts to be voted on are located here: *https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc3/ <https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc3/>* The hashes of the artifacts are as follows: apache-kylin-1.5.2-src.tar.gz.md511542b6fd4cfc9ed844e8f626d5960b7 apache-kylin-1.5.2-src.tar.gz.sha1 57c6e33dfcad34ddcfc805965b00ea6f1d04422f A staged Maven repository is available for review at: *https://repository.apache.org/content/repositories/orgapachekylin-1028/ <https://repository.apache.org/content/repositories/orgapachekylin-1028/>* Release artifacts are signed with the following key: https://people.apache.org/keys/committer/lidong.asc Please vote on releasing this package as Apache Kylin 1.5.2. The vote is open for the next 72 hours and passes if a majority of at least three +1 PPMC votes are cast. [ ] +1 Release this package as Apache Kylin 1.5.2 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) Thanks, Dong Li
[jira] [Created] (KYLIN-1725) Use KylinConfig inside coprocessor
Dong Li created KYLIN-1725: -- Summary: Use KylinConfig inside coprocessor Key: KYLIN-1725 URL: https://issues.apache.org/jira/browse/KYLIN-1725 Project: Kylin Issue Type: Improvement Components: Storage - HBase Reporter: Dong Li Assignee: Dong Li Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[VOTE] Release apache-kylin-1.5.2 (release candidate 2)
Hi all, I have created a build for Apache Kylin 1.5.2, release candidate 2. Changes highlights: - [KYLIN-1077] - Support Hive View as Lookup Table - [KYLIN-1515] - Make Kylin run on MapR - [KYLIN-1600] - Download diagnosis zip from GUI - [KYLIN-1672] - support kylin on cdh 5.7 Thanks to everyone who has contributed to this release. Here’s release notes: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12335528 The commit to be voted upon: *https://github.com/apache/kylin/commit/08807facb8889380de8da4515efe359d68d3187d <https://github.com/apache/kylin/commit/08807facb8889380de8da4515efe359d68d3187d>* Its hash is 08807facb8889380de8da4515efe359d68d3187d The artifacts to be voted on are located here: *https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc2/ <https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-1.5.2-rc2/>* The hashes of the artifacts are as follows: apache-kylin-1.5.2-src.tar.gz.md585c30082e99706000f35ace5d06efb41 apache-kylin-1.5.2-src.tar.gz.sha1 a4d20cc5f16dabfc1274f8b4408fdba0e9b1a1e7 A staged Maven repository is available for review at: *https://repository.apache.org/content/repositories/orgapachekylin-1027/ <https://repository.apache.org/content/repositories/orgapachekylin-1027/>* Release artifacts are signed with the following key: https://people.apache.org/keys/committer/lidong.asc Please vote on releasing this package as Apache Kylin 1.5.2. The vote is open for the next 72 hours and passes if a majority of at least three +1 PPMC votes are cast. [ ] +1 Release this package as Apache Kylin 1.5.2 [ ] 0 I don't feel strongly about it, but I'm okay with the release [ ] -1 Do not release this package because... Here is my vote: +1 (binding) Thanks, Dong Li
[jira] [Created] (KYLIN-1715) User cannot go back to an executing query if clicked other links by mistake
Dong Li created KYLIN-1715: -- Summary: User cannot go back to an executing query if clicked other links by mistake Key: KYLIN-1715 URL: https://issues.apache.org/jira/browse/KYLIN-1715 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v1.5.1 Reporter: Dong Li Assignee: Zhong,Jason Priority: Minor 1. In insight page, input a sql and submit it. 2. During its execution, click Monitor page 3. Got a warning alert, "You're executing query in current page, are you sure to leave the page? No matter click Yes or Cancel, I can never go back to the query. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1703) The not-thread-safe ToolRunner.run() will cause concurrency issue in job engine
Dong Li created KYLIN-1703: -- Summary: The not-thread-safe ToolRunner.run() will cause concurrency issue in job engine Key: KYLIN-1703 URL: https://issues.apache.org/jira/browse/KYLIN-1703 Project: Kylin Issue Type: Bug Components: Job Engine Affects Versions: v1.5.1 Reporter: Dong Li Assignee: Dong Li Refer to http://stackoverflow.com/questions/22462665/is-hadoops-toorunner-thread-safe ToolRunner.run() is not thread safe, if two MapReduceExecutable start MR Job at same time, there would be an NPE thrown from ToolRunner.run(). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: 编译Kylin
Hello Xin, About how to work with kylin's source code, please check kylin's dev documents first. http://kylin.apache.org/development/ Thanks, Dong Li 2016-05-12 23:59 GMT+08:00 Luke Han <luke...@gmail.com>: > Forward to @dev list, please subscribe and check there. > Thanks. > > Regards! > Luke Han > > > > > On Wed, May 11, 2016 at 2:21 AM -0700, "吴鑫" <wuxin1...@360.cn> wrote: > > > > > > > > > > > > > > > > > > > > > 您好， > > > 我想自己编译Kylin源码，想知道方法及注意事项 > > > > > > > > >
[jira] [Created] (KYLIN-1688) Illegal char on result dataset table
Dong Li created KYLIN-1688: -- Summary: Illegal char on result dataset table Key: KYLIN-1688 URL: https://issues.apache.org/jira/browse/KYLIN-1688 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v1.5.1 Reporter: Dong Li Assignee: Zhong,Jason >From github issue: Thanks, I build the latest version of this branch and it's working fine now. Somehow the chinese symbol for sorting made it into the resulting dataset table in the query page. Please check attached image. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1683) Row key could drag and drop in view state of cube - advanced settings tabpage
Dong Li created KYLIN-1683: -- Summary: Row key could drag and drop in view state of cube - advanced settings tabpage Key: KYLIN-1683 URL: https://issues.apache.org/jira/browse/KYLIN-1683 Project: Kylin Issue Type: Bug Components: Web Affects Versions: v1.5.1 Reporter: Dong Li Assignee: Zhong,Jason Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-1682) Wrong cuboid is chosen when join with subquery
Dong Li created KYLIN-1682:
--
Summary: Wrong cuboid is chosen when join with subquery
Key: KYLIN-1682
URL: https://issues.apache.org/jira/browse/KYLIN-1682
Project: Kylin
Issue Type: Bug
Components: Query Engine
Affects Versions: v1.5.1
Reporter: Dong Li
Assignee: liyang
Priority: Minor
In order to filter with top-n, tableau 9.2.6 will generate sql query like this:
SELECT KYLIN_SALES.LEAF_CATEG_ID ,"KYLIN_SALES"."LSTG_FORMAT_NAME" AS
"LSTG_FORMAT_NAME", (CASE WHEN (NOT ("t0"."XTableau_join_flag" IS NULL)) THEN
1 WHEN NOT (NOT ("t0"."XTableau_join_flag" IS NULL)) THEN 0 ELSE NULL END) AS
"io_Set_B_nk" FROM "DEFAULT"."KYLIN_SALES" "KYLIN_SALES" LEFT JOIN ( SELECT
"KYLIN_SALES"."LSTG_FORMAT_NAME" AS "LSTG_FORMAT_NAME", COUNT(1) AS
"XTableau_join_flag", SUM("KYLIN_SALES"."PRICE") AS "X__alias__A" FROM
"DEFAULT"."KYLIN_SALES" "KYLIN_SALES" GROUP BY
"KYLIN_SALES"."LSTG_FORMAT_NAME" ORDER BY 3 DESC LIMIT 2 ) "t0" ON
(("KYLIN_SALES"."LSTG_FORMAT_NAME" = "t0"."LSTG_FORMAT_NAME") OR
(("KYLIN_SALES"."LSTG_FORMAT_NAME" IS NULL) AND ("t0"."LSTG_FORMAT_NAME" IS
NULL))) GROUP BY KYLIN_SALES.LEAF_CATEG_ID, "KYLIN_SALES"."LSTG_FORMAT_NAME",
(CASE WHEN (NOT ("t0"."XTableau_join_flag" IS NULL)) THEN 1 WHEN NOT (NOT
("t0"."XTableau_join_flag" IS NULL)) THEN 0 ELSE NULL END)
There're 2 dimensions in this query: LEAF_CATEG_ID,LSTG_FORMAT_NAME, but the
chosen cuboid is [2], which only contains LSTG_FORMAT_NAME.
So in the resultset, the LEAF_CATEG_ID column get empty values.
BTW, data set is from sample.sh - learn_kylin.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (KYLIN-1679) bin/get-properties.sh cannot get property which contains space or equals sign
Dong Li created KYLIN-1679:
--
Summary: bin/get-properties.sh cannot get property which contains
space or equals sign
Key: KYLIN-1679
URL: https://issues.apache.org/jira/browse/KYLIN-1679
Project: Kylin
Issue Type: Bug
Components: Client - CLI
Reporter: Dong Li
Assignee: Dong Li
Priority: Minor
We have:
kylin.hive.beeline.params="-n root --hiveconf
hive.security.authorization.sqlstd.confwhitelist.append='mapreduce.job.*|dfs.*'
-u 'jdbc:hive2://localhost:1'"
But:
> echo `sh ${KYLIN_HOME}/bin/get-properties.sh kylin.hive.beeline.params`
hive.security.authorization.sqlstd.confwhitelist.append
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
