[CANCELLED][VOTE] Release apache-kylin-5.0.0-alpha (RC1)
This vote is cancelled due to apache rules. Xiaoxiang Yu, Apache Kylin PMC http://people.apache.org/~xxyu/
Re: [VOTE] Release apache-kylin-5.0.0-alpha (RC1)
Thanks, I will cancel this vote . Xiaoxiang Yu, Apache Kylin PMC http://people.apache.org/~xxyu/ On Fri, Apr 7, 2023 at 2:56 PM ShaoFeng Shi wrote: > Thanks Xiaoxiang for preparing this. > > While I have to give a -1, as I find several binary files included in the > source package: > > - build/async-profiler-lib has several .so binary files; > - jdbc/libs has several log4j jar files; > - spark-project/examples has a zip file; > - dev-support/local/images has several PNG files; > > Besides, the "kylin-it" and "examples" folders are beyond 100MB, which > makes the source release package is > 100MB, which is not reasonable; Seems > they include many sample data; If they are only for demo or test case > purpose, try to exclude them from the source release. > > > Best regards, > > Shaofeng Shi 史少锋 > Apache Kylin PMC, > Apache Incubator PMC, > Email: shaofeng...@apache.org > > Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html > Join Kylin user mail group: user-subscr...@kylin.apache.org > Join Kylin dev mail group: dev-subscr...@kylin.apache.org > > > > > Xiaoxiang Yu 于2023年4月7日周五 14:25写道： > > > 1. UT has passed in my test env. > > For some reasons, runing UT required some paramters, so I used scripts > > dev-support/unit_testing.sh > > ( > > > https://github.com/apache/kylin/blob/kylin-5.0.0-alpha/dev-support/unit_testing.sh > ) > > on > > docker container(https://hub.docker.com/r/apachekylin/release-machine ). > > > > > > 2. Happy path(including modeling and query etc) passed in my Hadoop > > env(Hadoop 3.2.1, Hive 3.1.2). > > Please note, before start Kylin by executing 'bin/kylin.sh start', please > > execute 'sbin/download-spark-user.sh' first . > > Current release candidate binary requires a specific Spark which > > downloaded by sbin/download-spark-user.sh. > > > > > > > > > > -- > > > > Best wishes to you ! > > From ：Xiaoxiang Yu > > > > > > > > > > > > At 2023-04-07 12:10:00, "Xiaoxiang Yu" wrote: > > >Hi all, > > > > > >I have created a build for Apache Kylin 5.0.0-alpha, release candidate > 1. > > >Changes highlights: > > > > > >[KYLIN-5216] - Upgrade metadata and engine : Kylin 5.0 > > >[KYLIN-5397] - Support sum_lc function > > >[KYLIN-5387] - Index planner phase 1 for kylin 5 > > >[KYLIN-5443] - Optimize the ER diagram of the model list page > > >[KYLIN-5459] - Partial Log Governance > > >[KYLIN-5374] - Provides Spark DDL & DML execution capability in GUI > > >[KYLIN-5309] - Propose more flexible runtime join scenarios for Kylin > > >[KYLIN-5297] - Add Kylin5 Jdbc module > > >[KYLIN-5390] - Build tasks support segment coverage > > >[KYLIN-5417] - streaming custom data parser > > >[KYLIN-5235] - Add doc for How to write document > > >[KYLIN-5236] - Add doc for how to contribute > > >[KYLIN-5249] - Add node status notification on web ui > > >[KYLIN-5256] - Add a cache for the system property get by the optional > > >config in KylinConfigBase > > >[KYLIN-5274] - Improve performance of getSubstitutor > > >[KYLIN-5361] - suggest set email content from hard code to configurable > > >files > > > > > > > > > > > >Thanks to everyone who has contributed to this release. > > > > > >Here are the release notes: > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12352155 > > > > > >The commit to being voted upon: > > > > > > https://github.com/apache/kylin/commit/efc9170e2f068dfe925007b11310efc32461b68e > > >Its hash is efc9170e2f068dfe925007b11310efc32461b68e. > > > > > >The artifacts to be voted on, including the source package and one > > >pre-compiled binary package are located here: > > > > > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-5.0.0-alpha-rc1/ > > > > > >The hash of the artifacts are as follows: > > >apache-kylin-5.0.0-alpha-source-release.zip.sha256 > > >1f5742861b487229355343815a0373da87e05f7203de1f729a50a0858f0c8204 > > > > > >apache-kylin-5.0.0-alpha-bin.tar.gz.sha256 > > >5af01b182396533e7bccebb1b1aef7135228f2f64b2ba2017447e7335b5a40b4 > > > > > >A staged Maven repository is available for review at: > > >https://repository.apache.org/content/repositories/orgapachekylin-1106/ > > > > > >Release artifacts are signed with the following key: > > >https://people.apache.org/keys/committer/xxyu.asc > > > > > > > > > > > >Please vote on releasing this package as Apache Kylin 5.0.0-alpha. > > > > > >The vote is open for the next 72 hours and passes if a majority of > > >at least three +1 PMC votes are cast. > > > > > >[ ] +1 Release this package as Apache Kylin 5.0.0-alpha > > >[ ] 0 I don't feel strongly about it, but I'm okay with the release > > >[ ] -1 Do not release this package because... > > > > > >Here is my vote: > > >+1 (binding) > > > > > >Xiaoxiang Yu, Apache Kylin PMC > > >http://people.apache.org/~xxyu/ > > >
MS SQL server as a source for Kylin
Hi All When I am trying to use SQL server as the source for Kylin via JDBC instead of Hive, as per the steps listed in the official documentation, getting an error. Error and config details are attached. I am using the Kylin docker. Kylin is working fine if i use hive as the source. Thanks and Regards Rajesh Abraham kylin.source.default=8 kylin.source.jdbc.connection-url=jdbc:sqlserver://10.236.221.117:1433;database=mm_usage kylin.source.jdbc.driver=com.microsoft.sqlserver.jdbc.SQLServerDriver kylin.source.jdbc.dialect=mssql kylin.source.jdbc.user=mm_usage kylin.source.jdbc.pass=CvidyaU123456 kylin.source.jdbc.sqoop-home=/usr/lib/sqoop/ kylin.source.jdbc.filed-delimiter=| kylin.source.jdbc.sqoop-mapper-num=4 Scoop results if i run it stand alone in the same docker [root@b419c84c48dc admin]# /usr/lib/sqoop/bin/sqoop-list-databases --username mm_usage --password CvidyaU123456 --connect jdbc:sqlserver://10.236.221.117:1433;database=mm_usage Warning: /usr/lib/sqoop/../hbase does not exist! HBase imports will fail. Please set $HBASE_HOME to the root of your HBase installation. Warning: /usr/lib/sqoop/../hcatalog does not exist! HCatalog jobs will fail. Please set $HCAT_HOME to the root of your HCatalog installation. Warning: /usr/lib/sqoop/../accumulo does not exist! Accumulo imports will fail. Please set $ACCUMULO_HOME to the root of your Accumulo installation. Warning: /usr/lib/sqoop/../zookeeper does not exist! Accumulo imports will fail. Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation. 23/04/05 13:24:21 INFO sqoop.Sqoop: Running Sqoop version: 1.4.5 23/04/05 13:24:21 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 23/04/05 13:24:21 INFO manager.SqlManager: Using default fetchSize of 1000 master tempdb model msdb mm_demo mm_usage --Lib listing for sqoop- [root@b419c84c48dc admin]# ls $KYLIN_HOME/ext sqljdbc41.jar sqljdbc_12.2.0.0_enu.tar.gz sqljdbc_6.0 sqljdbc_6.0.8112.200_enu.tar [root@b419c84c48dc admin]# ls $SQOOP_HOME/lib ant-contrib-1.0b3.jar commons-compress-1.4.1.jar jackson-mapper-asl-1.9.13.jar sqljdbc_12.2 xz-1.0.jar ant-eclipse-1.0-jvm1.2.jar commons-io-1.4.jar paranamer-2.3.jar sqljdbc_12.2.0.0_enu.tar avro-1.7.5.jar hsqldb-1.8.0.10.jar snappy-java-1.0.5.jar sqljdbc_6.0 avro-mapred-1.7.5-hadoop2.jar jackson-core-asl-1.9.13.jar sqljdbc41.jar sqljdbc_6.0.8112.200_enu.tar ---kylin exception is below- 2023-04-05 13:16:26,673 ERROR [http-bio-7070-exec-5] source.SourceManager:118 : Failed to create source: SourceType=8 java.lang.NullPointerException at org.apache.kylin.common.util.ClassUtil.forRenamedClass(ClassUtil.java:79) at org.apache.kylin.common.util.ClassUtil.forName(ClassUtil.java:74) at org.apache.kylin.source.SourceManager.createSource(SourceManager.java:115) at org.apache.kylin.source.SourceManager.getCachedSource(SourceManager.java:84) at org.apache.kylin.source.SourceManager.getProjectSource(SourceManager.java:93) at org.apache.kylin.rest.service.TableService.getSourceDbNames(TableService.java:272) at org.apache.kylin.rest.controller.TableController.showHiveDatabases(TableController.java:212) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:133) at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:97) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:854) at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:765) at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:85) at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:967) at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:901) at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:970) at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:861) at
Re: [VOTE] Release apache-kylin-5.0.0-alpha (RC1)
Thanks Xiaoxiang for preparing this. While I have to give a -1, as I find several binary files included in the source package: - build/async-profiler-lib has several .so binary files; - jdbc/libs has several log4j jar files; - spark-project/examples has a zip file; - dev-support/local/images has several PNG files; Besides, the "kylin-it" and "examples" folders are beyond 100MB, which makes the source release package is > 100MB, which is not reasonable; Seems they include many sample data; If they are only for demo or test case purpose, try to exclude them from the source release. Best regards, Shaofeng Shi 史少锋 Apache Kylin PMC, Apache Incubator PMC, Email: shaofeng...@apache.org Apache Kylin FAQ: https://kylin.apache.org/docs/gettingstarted/faq.html Join Kylin user mail group: user-subscr...@kylin.apache.org Join Kylin dev mail group: dev-subscr...@kylin.apache.org Xiaoxiang Yu 于2023年4月7日周五 14:25写道： > 1. UT has passed in my test env. > For some reasons, runing UT required some paramters, so I used scripts > dev-support/unit_testing.sh > ( > https://github.com/apache/kylin/blob/kylin-5.0.0-alpha/dev-support/unit_testing.sh) > on > docker container(https://hub.docker.com/r/apachekylin/release-machine ). > > > 2. Happy path(including modeling and query etc) passed in my Hadoop > env(Hadoop 3.2.1, Hive 3.1.2). > Please note, before start Kylin by executing 'bin/kylin.sh start', please > execute 'sbin/download-spark-user.sh' first . > Current release candidate binary requires a specific Spark which > downloaded by sbin/download-spark-user.sh. > > > > > -- > > Best wishes to you ! > From ：Xiaoxiang Yu > > > > > > At 2023-04-07 12:10:00, "Xiaoxiang Yu" wrote: > >Hi all, > > > >I have created a build for Apache Kylin 5.0.0-alpha, release candidate 1. > >Changes highlights: > > > >[KYLIN-5216] - Upgrade metadata and engine : Kylin 5.0 > >[KYLIN-5397] - Support sum_lc function > >[KYLIN-5387] - Index planner phase 1 for kylin 5 > >[KYLIN-5443] - Optimize the ER diagram of the model list page > >[KYLIN-5459] - Partial Log Governance > >[KYLIN-5374] - Provides Spark DDL & DML execution capability in GUI > >[KYLIN-5309] - Propose more flexible runtime join scenarios for Kylin > >[KYLIN-5297] - Add Kylin5 Jdbc module > >[KYLIN-5390] - Build tasks support segment coverage > >[KYLIN-5417] - streaming custom data parser > >[KYLIN-5235] - Add doc for How to write document > >[KYLIN-5236] - Add doc for how to contribute > >[KYLIN-5249] - Add node status notification on web ui > >[KYLIN-5256] - Add a cache for the system property get by the optional > >config in KylinConfigBase > >[KYLIN-5274] - Improve performance of getSubstitutor > >[KYLIN-5361] - suggest set email content from hard code to configurable > >files > > > > > > > >Thanks to everyone who has contributed to this release. > > > >Here are the release notes: > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12352155 > > > >The commit to being voted upon: > > > https://github.com/apache/kylin/commit/efc9170e2f068dfe925007b11310efc32461b68e > >Its hash is efc9170e2f068dfe925007b11310efc32461b68e. > > > >The artifacts to be voted on, including the source package and one > >pre-compiled binary package are located here: > > > https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-5.0.0-alpha-rc1/ > > > >The hash of the artifacts are as follows: > >apache-kylin-5.0.0-alpha-source-release.zip.sha256 > >1f5742861b487229355343815a0373da87e05f7203de1f729a50a0858f0c8204 > > > >apache-kylin-5.0.0-alpha-bin.tar.gz.sha256 > >5af01b182396533e7bccebb1b1aef7135228f2f64b2ba2017447e7335b5a40b4 > > > >A staged Maven repository is available for review at: > >https://repository.apache.org/content/repositories/orgapachekylin-1106/ > > > >Release artifacts are signed with the following key: > >https://people.apache.org/keys/committer/xxyu.asc > > > > > > > >Please vote on releasing this package as Apache Kylin 5.0.0-alpha. > > > >The vote is open for the next 72 hours and passes if a majority of > >at least three +1 PMC votes are cast. > > > >[ ] +1 Release this package as Apache Kylin 5.0.0-alpha > >[ ] 0 I don't feel strongly about it, but I'm okay with the release > >[ ] -1 Do not release this package because... > > > >Here is my vote: > >+1 (binding) > > > >Xiaoxiang Yu, Apache Kylin PMC > >http://people.apache.org/~xxyu/ >
Re:[VOTE] Release apache-kylin-5.0.0-alpha (RC1)
1. UT has passed in my test env. For some reasons, runing UT required some paramters, so I used scripts dev-support/unit_testing.sh (https://github.com/apache/kylin/blob/kylin-5.0.0-alpha/dev-support/unit_testing.sh) on docker container(https://hub.docker.com/r/apachekylin/release-machine ). 2. Happy path(including modeling and query etc) passed in my Hadoop env(Hadoop 3.2.1, Hive 3.1.2). Please note, before start Kylin by executing 'bin/kylin.sh start', please execute 'sbin/download-spark-user.sh' first . Current release candidate binary requires a specific Spark which downloaded by sbin/download-spark-user.sh. -- Best wishes to you ! From ：Xiaoxiang Yu At 2023-04-07 12:10:00, "Xiaoxiang Yu" wrote: >Hi all, > >I have created a build for Apache Kylin 5.0.0-alpha, release candidate 1. >Changes highlights: > >[KYLIN-5216] - Upgrade metadata and engine : Kylin 5.0 >[KYLIN-5397] - Support sum_lc function >[KYLIN-5387] - Index planner phase 1 for kylin 5 >[KYLIN-5443] - Optimize the ER diagram of the model list page >[KYLIN-5459] - Partial Log Governance >[KYLIN-5374] - Provides Spark DDL & DML execution capability in GUI >[KYLIN-5309] - Propose more flexible runtime join scenarios for Kylin >[KYLIN-5297] - Add Kylin5 Jdbc module >[KYLIN-5390] - Build tasks support segment coverage >[KYLIN-5417] - streaming custom data parser >[KYLIN-5235] - Add doc for How to write document >[KYLIN-5236] - Add doc for how to contribute >[KYLIN-5249] - Add node status notification on web ui >[KYLIN-5256] - Add a cache for the system property get by the optional >config in KylinConfigBase >[KYLIN-5274] - Improve performance of getSubstitutor >[KYLIN-5361] - suggest set email content from hard code to configurable >files > > > >Thanks to everyone who has contributed to this release. > >Here are the release notes: >https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316121=12352155 > >The commit to being voted upon: >https://github.com/apache/kylin/commit/efc9170e2f068dfe925007b11310efc32461b68e >Its hash is efc9170e2f068dfe925007b11310efc32461b68e. > >The artifacts to be voted on, including the source package and one >pre-compiled binary package are located here: >https://dist.apache.org/repos/dist/dev/kylin/apache-kylin-5.0.0-alpha-rc1/ > >The hash of the artifacts are as follows: >apache-kylin-5.0.0-alpha-source-release.zip.sha256 >1f5742861b487229355343815a0373da87e05f7203de1f729a50a0858f0c8204 > >apache-kylin-5.0.0-alpha-bin.tar.gz.sha256 >5af01b182396533e7bccebb1b1aef7135228f2f64b2ba2017447e7335b5a40b4 > >A staged Maven repository is available for review at: >https://repository.apache.org/content/repositories/orgapachekylin-1106/ > >Release artifacts are signed with the following key: >https://people.apache.org/keys/committer/xxyu.asc > > > >Please vote on releasing this package as Apache Kylin 5.0.0-alpha. > >The vote is open for the next 72 hours and passes if a majority of >at least three +1 PMC votes are cast. > >[ ] +1 Release this package as Apache Kylin 5.0.0-alpha >[ ] 0 I don't feel strongly about it, but I'm okay with the release >[ ] -1 Do not release this package because... > >Here is my vote: >+1 (binding) > >Xiaoxiang Yu, Apache Kylin PMC >http://people.apache.org/~xxyu/
