[jira] [Created] (KYLIN-3202) Doc directory for 2.3
Billy Liu created KYLIN-3202: Summary: Doc directory for 2.3 Key: KYLIN-3202 URL: https://issues.apache.org/jira/browse/KYLIN-3202 Project: Kylin Issue Type: Sub-task Reporter: Billy Liu -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3200) Enable SonarCloud for Code Analysis
Billy Liu created KYLIN-3200: Summary: Enable SonarCloud for Code Analysis Key: KYLIN-3200 URL: https://issues.apache.org/jira/browse/KYLIN-3200 Project: Kylin Issue Type: Task Reporter: Billy Liu Assignee: Billy Liu [https://sonarcloud.io|https://sonarcloud.io/] is one of the most popular Code Analysis online service. It could integrate with Travis very well. Developer could check the code coverage/bugs/vulnerabilities more easily. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-3198) More Chinese Howto Documents
Billy Liu created KYLIN-3198:
Summary: More Chinese Howto Documents
Key: KYLIN-3198
URL: https://issues.apache.org/jira/browse/KYLIN-3198
Project: Kylin
Issue Type: Improvement
Components: Documentation
Reporter: Billy Liu
Fix For: v2.3.0
>From [https://github.com/apache/kylin/pull/80]
Five how to documents are added:
{{[added Chinese version of
howto_optimize_build|https://github.com/apache/kylin/pull/80/commits/25206674f9eda19417a3c5d5f15dae8adcdb6952]}}
{{[added Chinese version of
howto_backup_metadata|https://github.com/apache/kylin/pull/80/commits/e773c00b030c29a79419403a86430715f1be57c3]}}
[added Chinese version of
howto_build_cube_with_restapi|https://github.com/apache/kylin/pull/80/commits/087fb355b74f34cd9cc345ad4c3d76df11fd3c97]
{{[added Chinese version of
howto_cleanup_storage|https://github.com/apache/kylin/pull/80/commits/7f2c690267b5a2b8c459e3ad07691c280ffd4e8c]}}
{{[added Chinese version of
howto_jdbc|https://github.com/apache/kylin/pull/80/commits/38477271eed350d9576f484b414ddf2576d54d06]}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (KYLIN-3195) Kylin v2.3.0 Release
Billy Liu created KYLIN-3195: Summary: Kylin v2.3.0 Release Key: KYLIN-3195 URL: https://issues.apache.org/jira/browse/KYLIN-3195 Project: Kylin Issue Type: Task Components: General Reporter: Billy Liu Assignee: Billy Liu Fix For: v2.3.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KYLIN-2879) Upgrade Spring & Spring Security to fix potential vulnerability
Billy Liu created KYLIN-2879: Summary: Upgrade Spring & Spring Security to fix potential vulnerability Key: KYLIN-2879 URL: https://issues.apache.org/jira/browse/KYLIN-2879 Project: Kylin Issue Type: Improvement Reporter: Billy Liu Assignee: Billy Liu Priority: Critical After running against VersionEye, the system shows that Kylin has "14 known security vulnerabilities. ". They are from commons-fileupload, commons-email, xercesImpl, spring-webmvc, spring jdbc, spring aop, spring-context-support, spring-test, spring-security-core, tomcat-catalina, spring-core libraries. Upgrade to newer version will fix the vulnerabilities. Following is the detail report: commons-fileupload : 1.3.1 2016-3092 Apache Commons Fileupload: Denial of Service https://bugzilla.redhat.com/show_bug.cgi?id=1349475 http://mail-archives.us.apache.org/mod_mbox/www-announce/201606.mbox/%3c6223ece6-2b41-ef4f-22f9-d3481e492...@apache.org%3E http://tomcat.apache.org/security.html http://svn.apache.org/viewvc/commons/proper/fileupload/trunk/RELEASE-NOTES.txt?r1=1745717=1749637_format=h https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2016-3092 Affected versions: <=1.3.1,1.3 && <=1.2.2,1.2 Mute this security issue CVE-2016-3092 CVE-2016-3092 https://h20566.www2.hpe.com/portal/site/hpsc/public/kb/docDisplay?docId=emr_na-c05324759 Affected versions: 1.3.1 Mute this security issue 2016-131 Apache Commons FileUpload Deserialization Gadget https://www.tenable.com/security/research/tra-2016-12 https://issues.apache.org/jira/browse/FILEUPLOAD-279 https://nvd.nist.gov/vuln/detail/CVE-2016-131 Affected versions: <=1.3.2 Mute this security issue commons-email : 1.4 2017-9801 SMTP header injection vulnerabilty https://commons.apache.org/proper/commons-email/security-reports.html https://nvd.nist.gov/vuln/detail/CVE-2017-9801 Affected versions: <=1.4 Mute this security issue xercesImpl : 2.11.0 2013-4002 Apache Xerces: XMLScanner resource exhaustion https://bugzilla.redhat.com/CVE-2013-4002 http://svn.apache.org/viewvc?view=revision=1499506 Affected versions: <=2.11.0 Mute this security issue spring-webmvc : 4.2.8.RELEASE CVE-2016-9878 CVE-2016-9878 https://pivotal.io/security/cve-2016-9878 Affected versions: 4.3.2, 4.2.3, 4.3.0, 4.2.1, 3.2.8, 4.2.0, 4.3.4, 4.2.5, 4.3.1, 4.2.2, 3.2.9, 4.3.3, 4.2.4, 3.2.7, 3.2.0, 4.2.6, 3.2.16, 3.2.5, 3.2.13, 3.2.6, 4.2.8, 3.2.3, 3.2.15, 3.2.12, 3.2.1, 4.2.7, 3.2.2, 3.2.14, 3.2.11, 3.2.10, 3.2.4, 3.2.17 Mute this security issue spring-jdbc : 4.2.8.RELEASE CVE-2016-9878 CVE-2016-9878 https://pivotal.io/security/cve-2016-9878 Affected versions: 4.3.2, 4.2.3, 4.3.0, 4.2.1, 3.2.8, 4.2.0, 4.3.4, 4.2.5, 4.3.1, 4.2.2, 3.2.9, 4.3.3, 4.2.4, 3.2.7, 3.2.0, 4.2.6, 3.2.16, 3.2.5, 3.2.13, 3.2.6, 4.2.8, 3.2.3, 3.2.15, 3.2.12, 3.2.1, 4.2.7, 3.2.2, 3.2.14, 3.2.11, 3.2.10, 3.2.4, 3.2.17 Mute this security issue spring-aop : 4.2.8.RELEASE CVE-2016-9878 CVE-2016-9878 https://pivotal.io/security/cve-2016-9878 Affected versions: 4.3.2, 4.2.3, 4.3.0, 4.2.1, 3.2.8, 4.2.0, 4.3.4, 4.2.5, 4.3.1, 4.2.2, 3.2.9, 4.3.3, 4.2.4, 3.2.7, 3.2.0, 4.2.6, 3.2.16, 3.2.5, 3.2.13, 3.2.6, 4.2.8, 3.2.3, 3.2.15, 3.2.12, 3.2.1, 4.2.7, 3.2.2, 3.2.14, 3.2.11, 3.2.10, 3.2.4, 3.2.17 Mute this security issue spring-context-support : 4.2.8.RELEASE CVE-2016-9878 CVE-2016-9878 https://pivotal.io/security/cve-2016-9878 Affected versions: 4.3.2, 4.2.3, 4.3.0, 4.2.1, 3.2.8, 4.2.0, 4.3.4, 4.2.5, 4.3.1, 4.2.2, 3.2.9, 4.3.3, 4.2.4, 3.2.7, 3.2.0, 4.2.6, 3.2.16, 3.2.5, 3.2.13, 3.2.6, 4.2.8, 3.2.3, 3.2.15, 3.2.12, 3.2.1, 4.2.7, 3.2.2, 3.2.14, 3.2.11, 3.2.10, 3.2.4, 3.2.17 Mute this security issue spring-test : 4.2.8.RELEASE CVE-2016-9878 CVE-2016-9878 https://pivotal.io/security/cve-2016-9878 Affected versions: 4.3.2, 4.2.3, 4.3.0, 4.2.1, 3.2.8, 4.2.0, 4.3.4, 4.2.5, 4.3.1, 4.2.2, 3.2.9, 4.3.3, 4.2.4, 3.2.7, 3.2.0, 4.2.6, 3.2.16, 3.2.5, 3.2.13, 3.2.6, 4.2.8, 3.2.3, 3.2.15, 3.2.12, 3.2.1, 4.2.7, 3.2.2, 3.2.14, 3.2.11, 3.2.10, 3.2.4, 3.2.17 Mute this security issue spring-security-core : 4.0.4.RELEASE 2016-5007 Spring Security / MVC Path Matching Inconsistency https://pivotal.io/security/cve-2016-5007 Affected versions: <=4.1.0.RELEASE Mute this security issue tomcat-catalina : 7.0.69 2016-3092 Apache Commons Fileupload: Denial of Service https://bugzilla.redhat.com/show_bug.cgi?id=1349475 http://mail-archives.us.apache.org/mod_mbox/www-announce/201606.mbox/%3c6223ece6-2b41-ef4f-22f9-d3481e492...@apache.org%3E http://tomcat.apache.org/security.html http://svn.apache.org/viewvc/commons/proper/fileupload/trunk/RELEASE-NOTES.txt?r1=1745717=1749637_format=h https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2016-3092 Affected versions: <=9.0.0.M7,9 && <=8.5.2,8.5 && <=8.0.35,8.0 && <=7.0.69,7 -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KYLIN-2816) Support hive unicode column name
Billy Liu created KYLIN-2816: Summary: Support hive unicode column name Key: KYLIN-2816 URL: https://issues.apache.org/jira/browse/KYLIN-2816 Project: Kylin Issue Type: Improvement Components: Job Engine Affects Versions: v2.1.0 Reporter: Billy Liu Assignee: Billy Liu Currently, if the column name has non-english character, such as Chinese, the FlatTableJob will fail . The logs said character '汉字’ not supported here. Could use back-tick to wrap the column name as literature. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KYLIN-2812) Save to wrong database when loading Kafka Topic
Billy Liu created KYLIN-2812: Summary: Save to wrong database when loading Kafka Topic Key: KYLIN-2812 URL: https://issues.apache.org/jira/browse/KYLIN-2812 Project: Kylin Issue Type: Bug Reporter: Billy Liu Assignee: Billy Liu Priority: Minor Fix For: v2.2.0 When loading Kafka Topic, user could select the destination database name. Currently, all topics are saved into DEFAULT database, which is not expected. Here is a bug during reading create table parameter. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KYLIN-2775) Streaming Cube Sample
Billy Liu created KYLIN-2775: Summary: Streaming Cube Sample Key: KYLIN-2775 URL: https://issues.apache.org/jira/browse/KYLIN-2775 Project: Kylin Issue Type: New Feature Components: General Reporter: Billy Liu Assignee: Billy Liu The sample.sh will generate sample table/model/cube for Hive-based data source. There is no easy way to generate sample table/model/cube for Kafka-based streaming cube. In this issue, the easy to use streaming sample will be provided. Will suppose user has Kafka installed already. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (KYLIN-2513) SUM measure return type should not overflow
Billy Liu created KYLIN-2513: Summary: SUM measure return type should not overflow Key: KYLIN-2513 URL: https://issues.apache.org/jira/browse/KYLIN-2513 Project: Kylin Issue Type: Bug Components: Metadata Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: hongbin ma Currently, the SUM measure return type is the same with original table column type, that would not work if the original table column has very limit digit capability. Take an example, the original column type is decimal(1,0), if we SUM on this column, the result will be overflow soon. Proposal: Define the return type much more clear. If the original column type is decimal with decimal point, no matter what the precision digit is, define the return type as decimal(19,4). If the original column type has no decimal point，define the return type as decimal(14,0). If the original column is integer family, the return type would be bigint. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2450) sample.sh should generate sample data on kylin.source.hive.database-for-flat-table, not hard code DEFAULT
Billy Liu created KYLIN-2450: Summary: sample.sh should generate sample data on kylin.source.hive.database-for-flat-table, not hard code DEFAULT Key: KYLIN-2450 URL: https://issues.apache.org/jira/browse/KYLIN-2450 Project: Kylin Issue Type: Improvement Components: General Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor Currently, the sample.sh will generate five sample tables into Hive DEFAULT database, and upload the sample cube, with hard-coded schema to DEFAULT also. But in some user cases, the DEFAULT database is not allowed to write. Kylin has property kylin.source.hive.database-for-flat-table, sample.sh should respect this variable and generate the samples into customized database. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2428) Cleanup unnecessary shaded libraries for job/coprocessor/jdbc/server
Billy Liu created KYLIN-2428: Summary: Cleanup unnecessary shaded libraries for job/coprocessor/jdbc/server Key: KYLIN-2428 URL: https://issues.apache.org/jira/browse/KYLIN-2428 Project: Kylin Issue Type: Improvement Components: General Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Kylin releases three libraries: kylin-coprocessor, kylin-jdbc, kylin-job and one web application: server. Currently, all libraries have shaded some used third party libraries into the package. For example, guava, curator, commons, kyro in kylin-job. The duplicate libraries in runtime classpath may have potential class loading conflicts and waste computing resource. We should leverage the hadoop provided libraries at runtime instead of the shaded one. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (KYLIN-2394) Upgrade Calcite to 1.11
Billy Liu created KYLIN-2394: Summary: Upgrade Calcite to 1.11 Key: KYLIN-2394 URL: https://issues.apache.org/jira/browse/KYLIN-2394 Project: Kylin Issue Type: New Feature Components: Query Engine Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Calcite has release 1.11.0 recently. In this JIRA, Kylin will upgrade the calcite to 1.11.0 and avatica to 1.9.0. Some potential refactor may be required, since protobuf 3.0(upgrade from 2.5) is needed by Calcite. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2368) Enable Findbugs plugin
Billy Liu created KYLIN-2368: Summary: Enable Findbugs plugin Key: KYLIN-2368 URL: https://issues.apache.org/jira/browse/KYLIN-2368 Project: Kylin Issue Type: Task Components: General Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor FindBugs looks for bugs in Java programs. It is based on the concept of bug patterns. A bug pattern is a code idiom that is often an error. This task will enable FindBugs for Kylin report. To check code by FindBugs: mvn findbugs:findbugs or mvn site -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2361) Upgrade to Tomcat 8.X
Billy Liu created KYLIN-2361: Summary: Upgrade to Tomcat 8.X Key: KYLIN-2361 URL: https://issues.apache.org/jira/browse/KYLIN-2361 Project: Kylin Issue Type: Task Components: Web Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor Apache Tomcat 8.5.x supports the same Servlet, JSP, EL, and WebSocket Specification versions as Apache Tomcat 8.0.x. In addition to that, it also implements the JASPIC 1.1 specification. There are significant changes in many areas under the hood, resulting in improved performance, stability, and total cost of ownership. Please refer to the Apache Tomcat 8.5 Changelog for details. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2360) Fix potential bugs reported by Sonar
Billy Liu created KYLIN-2360: Summary: Fix potential bugs reported by Sonar Key: KYLIN-2360 URL: https://issues.apache.org/jira/browse/KYLIN-2360 Project: Kylin Issue Type: Improvement Reporter: Billy Liu Assignee: Billy Liu Priority: Minor https://builds.apache.org/analysis/component_issues?id=org.apache.kylin%3Akylin#resolved=false|types=BUG reports some potential bugs, I will try to fix some of them to improve the code quality. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2327) Enable check-style for test code
Billy Liu created KYLIN-2327: Summary: Enable check-style for test code Key: KYLIN-2327 URL: https://issues.apache.org/jira/browse/KYLIN-2327 Project: Kylin Issue Type: Task Components: General Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2323) Refine Table load/unload error message
Billy Liu created KYLIN-2323: Summary: Refine Table load/unload error message Key: KYLIN-2323 URL: https://issues.apache.org/jira/browse/KYLIN-2323 Project: Kylin Issue Type: Improvement Components: REST Service Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor There is no exception handling in TableController, so most of exceptions will not be found in kylin.log, but kylin.out. The TableController should provide more useful messages, and be stable when exception happens. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2317) Hybrid Cube CLI Tools
Billy Liu created KYLIN-2317: Summary: Hybrid Cube CLI Tools Key: KYLIN-2317 URL: https://issues.apache.org/jira/browse/KYLIN-2317 Project: Kylin Issue Type: New Feature Components: Metadata Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Provide CLI tools for Hybrid Cube feature 1. Create new Hybrid Cube by merging existing cubes 2. Check cubes no overlap 3. Merge existing Cube into existing Hybrid Cube -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2312) Display Server Config/Environment in order
Billy Liu created KYLIN-2312: Summary: Display Server Config/Environment in order Key: KYLIN-2312 URL: https://issues.apache.org/jira/browse/KYLIN-2312 Project: Kylin Issue Type: Improvement Components: Web Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor The system tab page shows Server Config and Environment, it's useful for debugging, but the item order is undetermined currently. The Config should show the same order as the properties file. The Environment should show the items order by name. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2300) Show MapReduce waiting time for each build step
Billy Liu created KYLIN-2300: Summary: Show MapReduce waiting time for each build step Key: KYLIN-2300 URL: https://issues.apache.org/jira/browse/KYLIN-2300 Project: Kylin Issue Type: Bug Components: Web Reporter: Billy Liu Assignee: Billy Liu Priority: Minor In the Monitor Page, the total MapReduce waiting time will be shown for the build job, but without each step MapReduce waiting time. User could not know which step cause the waiting. Hope to display the waiting time for each step on both GUI and job API. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2296) Allow cube to override kafka configuration
Billy Liu created KYLIN-2296: Summary: Allow cube to override kafka configuration Key: KYLIN-2296 URL: https://issues.apache.org/jira/browse/KYLIN-2296 Project: Kylin Issue Type: Improvement Reporter: Billy Liu Assignee: Billy Liu In KYLIN-2131, we enable kylin-kafka-consumer.xml as the default Kafka configuration file. Like existing cube overwrite feature which supports Hive and MR job overwriting, it should support kafka overwriting also. The Kafka related prefix will be added into KylinConfig, and user could input the overwrite properties on GUI. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2293) Refactor KylinConfig to separate test case into KylinTestConfig
Billy Liu created KYLIN-2293: Summary: Refactor KylinConfig to separate test case into KylinTestConfig Key: KYLIN-2293 URL: https://issues.apache.org/jira/browse/KYLIN-2293 Project: Kylin Issue Type: Task Components: Metadata Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor Currently, here are some "For test" method exposed in KylinConfig, the refactor would move all these "For test" methods into another Test related class, to reduce the unnecessary APIs. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2265) Adjust default config for resource-limit sandbox
Billy Liu created KYLIN-2265: Summary: Adjust default config for resource-limit sandbox Key: KYLIN-2265 URL: https://issues.apache.org/jira/browse/KYLIN-2265 Project: Kylin Issue Type: Improvement Components: General Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Most users deploy Kylin on their own sandbox for the first trial. Most sandbox has most 8G memory. The most used sandboxes are HDP sandbox and CDH sandbox. We'd better make the default kylin configuration convenient for these sandbox environment. The suggestion includes reducing region-cut-gb, hfile-size-gb, max-region-count, reduce-input-mb, max-reducer-number,mapreduce.map.memory.mb,mapreduce.map.java.opts. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2252) Enhance project/model/cube name check
Billy Liu created KYLIN-2252: Summary: Enhance project/model/cube name check Key: KYLIN-2252 URL: https://issues.apache.org/jira/browse/KYLIN-2252 Project: Kylin Issue Type: Improvement Components: REST Service Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor Enhance the project/model/cube name check in Controller side, only letters, numbers and underline are valid. Others will throw out BadRequestException. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (KYLIN-2251) JDBC Driver httpcore dependency conflict
Billy Liu created KYLIN-2251: Summary: JDBC Driver httpcore dependency conflict Key: KYLIN-2251 URL: https://issues.apache.org/jira/browse/KYLIN-2251 Project: Kylin Issue Type: Bug Components: Driver - JDBC Affects Versions: v1.6.0 Reporter: Billy Liu Assignee: Billy Liu Priority: Minor Report by xwhfcenter from github: "There is a conflict in dependency of httpcore in module JDBC Driver" -- This message was sent by Atlassian JIRA (v6.3.4#6332)
