[jira] [Commented] (KYLIN-5843) Column access control permissions do not take effect for query-push-down
[ https://issues.apache.org/jira/browse/KYLIN-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836498#comment-17836498 ] ASF subversion and git services commented on KYLIN-5843: Commit e804eee81eff19424ea61c6899c226ba3d5fcf59 in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=e804eee81e ] KYLIN-5844 & KYLIN-5843 Column ACL works for PushDown 1. Column ACL works for PushDown 2. Flat-table sql should consider acl > Column access control permissions do not take effect for query-push-down > > > Key: KYLIN-5843 > URL: https://issues.apache.org/jira/browse/KYLIN-5843 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > *Dev Design* > Parse the SQL query to generate a SqlNode, and traverse this SqlNode to find > all tables used in the database. Replace each of these tables with a subquery > that retrieves only the columns that the user has permission to access. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5845) Updating the model metadata when getting the model list with high concurrency may cause the model metadata cache to be abnormal and the model status to become broken
[ https://issues.apache.org/jira/browse/KYLIN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836499#comment-17836499 ] ASF subversion and git services commented on KYLIN-5845: Commit 0bbb74ee794beb17a8a501f5df5dfcc421bfd2a1 in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0bbb74ee79 ] KYLIN-5845 Avoid model initialization for multi-thread > Updating the model metadata when getting the model list with high concurrency > may cause the model metadata cache to be abnormal and the model status to > become broken > - > > Key: KYLIN-5845 > URL: https://issues.apache.org/jira/browse/KYLIN-5845 > Project: Kylin > Issue Type: Bug > Components: Metadata >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Fix the issue caused by concurrent initialization by checking if the model > has already been initialized. If so, skip the initialization step. Otherwise, > perform a copy operation first and then initialize the model to avoid > concurrent initialization problems. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5840) Upgrade org.xerial.snappy:snappy-java to version 1.1.10.4
[ https://issues.apache.org/jira/browse/KYLIN-5840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836495#comment-17836495 ] ASF subversion and git services commented on KYLIN-5840: Commit 1c05436a01d41e490c986ee32c0ca1d07c6e90e0 in kylin's branch refs/heads/kylin5 from huangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1c05436a01 ] KYLIN-5840 Fix vulnerability, Upgrade org.xerial.snappy:snappy-java to version 1.1.10.4 > Upgrade org.xerial.snappy:snappy-java to version 1.1.10.4 > - > > Key: KYLIN-5840 > URL: https://issues.apache.org/jira/browse/KYLIN-5840 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Upgrade org.xerial.snappy:snappy-java to version 1.1.10.4 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5810) Add the spark.session.isDefined check in queryExec.
[ https://issues.apache.org/jira/browse/KYLIN-5810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836478#comment-17836478 ] ASF subversion and git services commented on KYLIN-5810: Commit dcfa26067ff19352e064801d191f27c98fe1e6d2 in kylin's branch refs/heads/kylin5 from Yinghao Lin [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=dcfa26067f ] KYLIN-5810 Add the spark.session.isDefined check in queryExec > Add the spark.session.isDefined check in queryExec. > --- > > Key: KYLIN-5810 > URL: https://issues.apache.org/jira/browse/KYLIN-5810 > Project: Kylin > Issue Type: Bug >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > > Add the spark.session.isDefined check in queryExec. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5382) Query hit index result is incorrect
[ https://issues.apache.org/jira/browse/KYLIN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836493#comment-17836493 ] ASF subversion and git services commented on KYLIN-5382: Commit be22ca0de7e512df5dc443b99ed6df63635f9dfe in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=be22ca0de7 ] KYLIN-5839 Block agg-push-down for non-equal-join KYLIN-5382 only deals with the equal-join conditions and gives the corresponding test cases. KYLIN-5831 fixed the problem where non-equiv-join conditions were incorrectly converted to equivalent conditions. Due to the lack of test cases, a regression bug occurs in ContextUtil.isJoinFromSameContext. The related non-equiv-join sql is as follows. If you want a corresponding equal-join sql, just remove the condition content `or (t2.fcol_10 is null and t5.fcol_17 is null)`. ```sql select t2.fcol_7 fcol_7, count(distinct t2.fcol_6) fcol_6 from (select t1.company_code fcol_6, t1.type_name fcol_7, case when t1.created_date = t0.fcol_1 then 'TRUE' else 'FALSE' end fcol_10 from ( select company_code, created_date, type_name from "DEFAULT"."TEST_AGG_PUSH_DOWN" ) t1 join ( select company_code, max(created_date) fcol_1 from "DEFAULT"."TEST_AGG_PUSH_DOWN" group by company_code ) t0 on t1.company_code = t0.company_code ) t2 join ( select 'TRUE' fcol_17 ) t5 on t2.fcol_10 = t5.fcol_17 or (t2.fcol_10 is null and t5.fcol_17 is null) group by t2.fcol_7 ``` > Query hit index result is incorrect > --- > > Key: KYLIN-5382 > URL: https://issues.apache.org/jira/browse/KYLIN-5382 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-alpha >Reporter: leejaywei >Assignee: leejaywei >Priority: Major > Fix For: 5.0-alpha > > > 查询命中索引返回结果不正确 > 单个子查询返回都有结果，但是进行join后就没有结果，同样的查询下压查询有结果 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5828) During multi-jobs concurrent building, the flat table may use inconsistent global dictionaries, resulting in incorrect count distinct query results.
[ https://issues.apache.org/jira/browse/KYLIN-5828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836484#comment-17836484 ] ASF subversion and git services commented on KYLIN-5828: Commit c61dc4189968f29f8e56e98f72a16f100e9d6e2b in kylin's branch refs/heads/kylin5 from huangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=c61dc41899 ] KYLIN-5828 Concurrently dict v2 jobs lead to abnormal encoding result > During multi-jobs concurrent building, the flat table may use inconsistent > global dictionaries, resulting in incorrect count distinct query results. > > > Key: KYLIN-5828 > URL: https://issues.apache.org/jira/browse/KYLIN-5828 > Project: Kylin > Issue Type: Bug > Components: Storage - Parquet >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > > *Root Cause* > When multiple tasks are concurrently building and using the same global > dictionary, the consistency of the dictionary version used in the flat table > encoding process is not guaranteed. At the same time, another task expands > the dictionary, causing some flat table partitions to mistakenly use the new > version of the dictionary partition file. Due to the inconsistent data > distribution, the correct dictionary content cannot be obtained, resulting in > a flat table encoding column of 0 and ultimately causing an abnormal count > distinct value. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5811) Enhance SCD2, history table supports left-closed and right-closed time interval
[
https://issues.apache.org/jira/browse/KYLIN-5811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836479#comment-17836479
]
ASF subversion and git services commented on KYLIN-5811:
Commit 5092e7a239146305197ad6fb5fda28fdc090b376 in kylin's branch
refs/heads/kylin5 from Pengfei Zhan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5092e7a239 ]
KYLIN-5811 Enhancement of SCD2
1. scd2 support join pairs of (>=, <=) and (>, <=)
2. scd2 support recommendation
3. correct toString and compare of NonEquiJoinCondition
4. flat-table sql fix & add a setting to control suggest scd2 model
Support semantically equivalent scd2 join conditions.
For example: "a >= b and c > a" is equivalent to "a >= b and a < c".
> Enhance SCD2, history table supports left-closed and right-closed time
> interval
> ---
>
> Key: KYLIN-5811
> URL: https://issues.apache.org/jira/browse/KYLIN-5811
> Project: Kylin
> Issue Type: Improvement
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
>
>
> Enhance SCD2, history table supports left-closed and right-closed time
> interval.
> Current SCD2 only support \{ >= and < }join condition.
> After this issue we support \{ >=, < }, \{>=, <=}, \{ >, <=} join condition.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5815) fix add primary key failed when upgrade concurrently
[ https://issues.apache.org/jira/browse/KYLIN-5815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836481#comment-17836481 ] ASF subversion and git services commented on KYLIN-5815: Commit 768a5ececcd855b0f796881d42b36b17088c61d5 in kylin's branch refs/heads/kylin5 from Jiawei Li [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=768a5ececc ] KYLIN-5815 Failed to add primaryKey of table when upgrading concurrently > fix add primary key failed when upgrade concurrently > > > Key: KYLIN-5815 > URL: https://issues.apache.org/jira/browse/KYLIN-5815 > Project: Kylin > Issue Type: Improvement > Components: Metadata >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > fix add primary key failed when upgrade concurrently -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5837) After turning off the computed column function, the query cannot hit the existing recommended index
[ https://issues.apache.org/jira/browse/KYLIN-5837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836490#comment-17836490 ] ASF subversion and git services commented on KYLIN-5837: Commit 148d8f61aaafbca0c207d76f0747a85ed0b11fbb in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=148d8f61aa ] KYLIN-5837 Support only reusing user defined computedColumns > After turning off the computed column function, the query cannot hit the > existing recommended index > --- > > Key: KYLIN-5837 > URL: https://issues.apache.org/jira/browse/KYLIN-5837 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > *Dev Design* > * The configuration parameter > "kylin.metadata.only-reuse-user-defined-computed-column=false" is designed to > enable the usage of user-defined computed columns for reusing only. This > decouples the feature of shielding columns from the configuration, which > means that the shielding column feature can still be used even with this > parameter set to false. > * By default, Kylin uses computed columns (CC) for implicit column > conversions, which means that user-defined computed columns can replace > implicit expressions. However, if the configuration parameter > "kylin.query.implicit-computed-column-convert" is set to "false", the > user-defined computed columns will not be used for implicit column > conversions. > * The configuration parameter "kylin.query.agg-computed-column-rewrite" is > related to computed columns v2 and it replaces columns at the semantic > RelNode level, while "kylin.query.implicit-computed-column-convert" performs > column replacements at the SqlNode level. As a general rule, if > "kylin.query.implicit-computed-column-convert" is set to false, then > "kylin.query.agg-computed-column-rewrite" will not take effect either. > However, if "kylin.query.implicit-computed-column-convert" is set to true, > then "kylin.query.agg-computed-column-rewrite" can be set to either true or > false. > * All three configurations can now be modified at the project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5832) Add API to determine whether the query hits the index
[
https://issues.apache.org/jira/browse/KYLIN-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836487#comment-17836487
]
ASF subversion and git services commented on KYLIN-5832:
Commit d7f37675e2de44478da78d5ae7b4b70fd043b13f in kylin's branch
refs/heads/kylin5 from haocheni
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d7f37675e2 ]
KYLIN-5832 Support queryDetect api
> Add API to determine whether the query hits the index
> -
>
> Key: KYLIN-5832
> URL: https://issues.apache.org/jira/browse/KYLIN-5832
> Project: Kylin
> Issue Type: Improvement
> Components: Others
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> Add a new API to determine if a query hits an index. This API has the
> following functions.
> # Determine whether the model is hit or not.
> # Determine if there is data in the segment.
> API : {{POST [http://host:port/kylin/api/query/detection]}}
> ||*Param*||*Datatype*||Required||
> |project|string|True|
> |sql|string|
> True
> |
> |limit|int|False|
> |offset|int|False|
> Sample
> {code:java}
> curl --location 'http://host:port/kylin/api/query/detection' \
> --header 'Accept: application/vnd.apache.kylin-v4-public+json' \
> --header 'Accept-Language: cn' \
> --header 'Content-Type: application/json;charset=UTF-8' \
> --data '{
> "project": "project_ch",
> "sql": "SELECT LO_PARTKEY, SUM(LO_REVENUE) AS TOTAL_REVENUE\nFROM
> SSB.P_LINEORDER\nWHERE LO_ORDERDATE between '\''19920101'\'' AND
> '\''19970803'\'' \ngroup by LO_PARTKEY\norder by SUM(LO_REVENUE) DESC\nLIMIT
> 500"
> }' {code}
> Response
> ||*Param*||*Datatype*||
> |code|string|
> |data|object|
> |is_exception|boolean|
> |exception_message|string|
> |query_id|string|
> |is_push_down
> |boolean|
> |is_post_aggregation
> |boolean|
> |is_table_index
> |boolean|
> |is_base_index
> |boolean|
> |is_cache|boolean|
> |is_constants|boolean|
> |realizations
> |object[]|
> |model_id|string|
> |model_alias|string|
> |layout_id|int|
> |index_type|string|
> |partial_match_model|boolean|
> |valid|boolean|
> |is_table_index
> |boolean|
> |is_base_index
> |boolean|
> Sample
> {code:java}
> {
> "code": "000",
> "data": {
> "is_exception": false,
> "exception_message": null,
> "query_id": "0ef8d8f2-c234-8211-f841-5b3db61ba217",
> "is_push_down": false,
> "is_post_aggregation": true,
> "is_table_index": false,
> "is_base_index": true,
> "is_cache": false,
> "is_constants": false,
> "realizations": [
> {
> "model_id": "aa7d0eab-6f72-3b02-019f-9f2fc84a0ecb",
> "model_alias": "AUTO_MODEL_P_LINEORDER_1",
> "layout_id": 1,
> "index_type": "Agg Index",
> "partial_match_model": false,
> "valid": true,
> "is_table_index": false,
> "is_base_index": true
> }
> ]
> },
> "msg": ""
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5814) query cache support redis sentinel mode
[ https://issues.apache.org/jira/browse/KYLIN-5814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836480#comment-17836480 ] ASF subversion and git services commented on KYLIN-5814: Commit ebd2f3d6704a566896b60f7a3c67bf7226c67348 in kylin's branch refs/heads/kylin5 from haocheni [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=ebd2f3d670 ] KYLIN-5814 Support lettuce sentinel mode > query cache support redis sentinel mode > --- > > Key: KYLIN-5814 > URL: https://issues.apache.org/jira/browse/KYLIN-5814 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > query cache support redis sentinel mode -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5833) Refactor QueryContext
[ https://issues.apache.org/jira/browse/KYLIN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836488#comment-17836488 ] ASF subversion and git services commented on KYLIN-5833: Commit 412eff5c73908508e3967412a2dbffd76d171b30 in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=412eff5c73 ] KYLIN-5833 Use TableIndex answer select * only works for query > Refactor QueryContext > - > > Key: KYLIN-5833 > URL: https://issues.apache.org/jira/browse/KYLIN-5833 > Project: Kylin > Issue Type: Improvement >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Refactor QueryContext -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5829) Add a tool for generating sql from dumped metadata
[
https://issues.apache.org/jira/browse/KYLIN-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836485#comment-17836485
]
ASF subversion and git services commented on KYLIN-5829:
Commit f9255a515d38edafd099c81712c0b6ff8e7038d7 in kylin's branch
refs/heads/kylin5 from Pengfei Zhan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=f9255a515d ]
KYLIN-5829 Add a tool for generating sql from dumped metadata
> Add a tool for generating sql from dumped metadata
> --
>
> Key: KYLIN-5829
> URL: https://issues.apache.org/jira/browse/KYLIN-5829
> Project: Kylin
> Issue Type: New Feature
> Components: Metadata
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> Add a tool for generating sql from dumped metadata
> The usage of the command is {{./bin/creata-table.sh
> \{absolute_table_directory}}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5817) After sending the query, the number of scanRows and scanBytes in response are inaccurate
[
https://issues.apache.org/jira/browse/KYLIN-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836483#comment-17836483
]
ASF subversion and git services commented on KYLIN-5817:
Commit 00352e8c2d53307b4cf3f847fc6bbf2a869c4520 in kylin's branch
refs/heads/kylin5 from haocheni
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=00352e8c2d ]
KYLIN-5817 Query scanRows and bytes are incorrect
> After sending the query, the number of scanRows and scanBytes in response are
> inaccurate
>
>
> Key: KYLIN-5817
> URL: https://issues.apache.org/jira/browse/KYLIN-5817
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> h3. Background
> When KE calls the query interface, it is found that the scan row count
> {{scanRows}} and scan byte count {{scanBytes}} in the response are not
> accurate.
> h3. Root Cause
> The query interface internally calls the
> {{collectAdaptiveSparkPlanExecMetrics}} method of {{{}QueryMetricUtils{}}}.
> When iterating through {{{}exec.children.foreach{}}}, if the {{child}} is a
> {{{}SparkPlan{}}}, each time the results of the new {{child}} overwrite the
> {{newScanRow}} and {{newScanBytes}} variables without adding them up.
> h3. Dev Design
> To address the issue, replace the assignment operator {{=}} with the compound
> addition assignment operator {{+=}} to ensure that the results are properly
> accumulated. This change will allow for the correct aggregation of scan row
> count and scan byte count in each iteration.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5805) Optimize the transaction processing process and improve the response performance of concurrent operations
[ https://issues.apache.org/jira/browse/KYLIN-5805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836474#comment-17836474 ] ASF subversion and git services commented on KYLIN-5805: Commit 085d7072167bf199094833ef73f0d9cc5741b075 in kylin's branch refs/heads/kylin5 from Zhiting Guo [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=085d707216 ] KYLIN-5805 Refactor project lock - Co-authored-by: junqing.cai Co-authored-by: Jiale He Co-authored-by: Zhiting Guo > Optimize the transaction processing process and improve the response > performance of concurrent operations > - > > Key: KYLIN-5805 > URL: https://issues.apache.org/jira/browse/KYLIN-5805 > Project: Kylin > Issue Type: Improvement >Reporter: Zhimin Wu >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5846) upgrade spark version to 3.2.0-kylin-4.6.16.0
[ https://issues.apache.org/jira/browse/KYLIN-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836500#comment-17836500 ] ASF subversion and git services commented on KYLIN-5846: Commit 3f9b9c83bedbce17be0dcac5af427c636353621a in kylin's branch refs/heads/kylin5 from huangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3f9b9c83be ] KYLIN-5846 upgrade spark version to 3.2.0-kylin-4.6.16.0 > upgrade spark version to 3.2.0-kylin-4.6.16.0 > - > > Key: KYLIN-5846 > URL: https://issues.apache.org/jira/browse/KYLIN-5846 > Project: Kylin > Issue Type: Bug > Components: Spark Engine >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > upgrade spark version to 3.2.0-kylin-4.6.16.0.1 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5830) When the query connects two or more tables, the query results are inconsistent whether the order by field is in the select field or not
[
https://issues.apache.org/jira/browse/KYLIN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836486#comment-17836486
]
ASF subversion and git services commented on KYLIN-5830:
Commit 191d08c272b48d04441783290459291f70c2e9e6 in kylin's branch
refs/heads/kylin5 from Pengfei Zhan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=191d08c272 ]
KYLIN-5830 Push columns of sortRel to subOlapContexts
> When the query connects two or more tables, the query results are
> inconsistent whether the order by field is in the select field or not
> ---
>
> Key: KYLIN-5830
> URL: https://issues.apache.org/jira/browse/KYLIN-5830
> Project: Kylin
> Issue Type: New Feature
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> Q1:
> {code:java}
> select CUSTOMER.C_PHONE
> -- ,LO_PARTKEY
> from SSB.CUSTOMER left join SSB.LINEORDER on
> CUSTOMER.C_CUSTKEY=LINEORDER.LO_CUSTKEY
> order by LINEORDER.LO_PARTKEY NULLS LAST
> LIMIT 500{code}
> Calcite Plan：
> {code:java}
> KapProjectRel(C_PHONE=[$6], ctx=[])
> KapLimitRel(ctx=[], fetch=[500])
> KapSortRel(sort0=[$12], dir0=[ASC], ctx=[])
> KapJoinRel(condition=[=($0, $11)], joinType=[left], ctx=[])
> KapTableScan(table=[[SSB, CUSTOMER]], ctx=[1@NDataflow [test]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8]])
> KapTableScan(table=[[SSB, LINEORDER]], ctx=[2@NDataflow [test1]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17]]){code}
> Q2:
> {code:java}
> select CUSTOMER.C_PHONE
> ,LO_PARTKEY
> from SSB.CUSTOMER left join SSB.LINEORDER on
> CUSTOMER.C_CUSTKEY=LINEORDER.LO_CUSTKEY
> order by LINEORDER.LO_PARTKEY NULLS LAST
> LIMIT 500{code}
> Calcite Plan
> {code:java}
> KapLimitRel(ctx=[], fetch=[500])
> KapSortRel(sort0=[$1], dir0=[ASC], ctx=[])
> KapProjectRel(C_PHONE=[$6], LO_PARTKEY=[$12], ctx=[])
> KapJoinRel(condition=[=($0, $11)], joinType=[left], ctx=[])
> KapTableScan(table=[[SSB, CUSTOMER]], ctx=[1@NDataflow [test]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8]])
> KapTableScan(table=[[SSB, LINEORDER]], ctx=[2@NDataflow [test1]],
> fields=[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17]])
> {code}
> In SortRel, the columns used are not pushed down to the sub OlapContext. To
> fix this issue, need to add the columns to the sub OlapContext.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5831) Enhance SCD2, history table supports left-closed and right-closed time interval
[
https://issues.apache.org/jira/browse/KYLIN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836494#comment-17836494
]
ASF subversion and git services commented on KYLIN-5831:
Commit be22ca0de7e512df5dc443b99ed6df63635f9dfe in kylin's branch
refs/heads/kylin5 from Pengfei Zhan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=be22ca0de7 ]
KYLIN-5839 Block agg-push-down for non-equal-join
KYLIN-5382 only deals with the equal-join conditions and gives the
corresponding test cases.
KYLIN-5831 fixed the problem where non-equiv-join conditions were
incorrectly converted to equivalent conditions. Due to the lack of test
cases, a regression bug occurs in ContextUtil.isJoinFromSameContext.
The related non-equiv-join sql is as follows.
If you want a corresponding equal-join sql, just remove the condition
content `or (t2.fcol_10 is null and t5.fcol_17 is null)`.
```sql
select t2.fcol_7 fcol_7, count(distinct t2.fcol_6) fcol_6
from (select t1.company_code fcol_6, t1.type_name fcol_7,
case when t1.created_date = t0.fcol_1 then 'TRUE'
else 'FALSE' end fcol_10
from ( select company_code, created_date, type_name
from "DEFAULT"."TEST_AGG_PUSH_DOWN" ) t1
join ( select company_code, max(created_date) fcol_1
from "DEFAULT"."TEST_AGG_PUSH_DOWN"
group by company_code
) t0 on t1.company_code = t0.company_code
) t2 join ( select 'TRUE' fcol_17 ) t5
on t2.fcol_10 = t5.fcol_17 or (t2.fcol_10 is null and t5.fcol_17 is null)
group by t2.fcol_7
```
> Enhance SCD2, history table supports left-closed and right-closed time
> interval
> ---
>
> Key: KYLIN-5831
> URL: https://issues.apache.org/jira/browse/KYLIN-5831
> Project: Kylin
> Issue Type: Improvement
> Components: Spark Engine
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> Current SCD2 only support \{ >= and < }join condition.
> After this issue we support \{ >=, < }, \{>=, <=}, \{ >, <=} join condition.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5839) Block agg-push-down for non-equal-join
[
https://issues.apache.org/jira/browse/KYLIN-5839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836492#comment-17836492
]
ASF subversion and git services commented on KYLIN-5839:
Commit be22ca0de7e512df5dc443b99ed6df63635f9dfe in kylin's branch
refs/heads/kylin5 from Pengfei Zhan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=be22ca0de7 ]
KYLIN-5839 Block agg-push-down for non-equal-join
KYLIN-5382 only deals with the equal-join conditions and gives the
corresponding test cases.
KYLIN-5831 fixed the problem where non-equiv-join conditions were
incorrectly converted to equivalent conditions. Due to the lack of test
cases, a regression bug occurs in ContextUtil.isJoinFromSameContext.
The related non-equiv-join sql is as follows.
If you want a corresponding equal-join sql, just remove the condition
content `or (t2.fcol_10 is null and t5.fcol_17 is null)`.
```sql
select t2.fcol_7 fcol_7, count(distinct t2.fcol_6) fcol_6
from (select t1.company_code fcol_6, t1.type_name fcol_7,
case when t1.created_date = t0.fcol_1 then 'TRUE'
else 'FALSE' end fcol_10
from ( select company_code, created_date, type_name
from "DEFAULT"."TEST_AGG_PUSH_DOWN" ) t1
join ( select company_code, max(created_date) fcol_1
from "DEFAULT"."TEST_AGG_PUSH_DOWN"
group by company_code
) t0 on t1.company_code = t0.company_code
) t2 join ( select 'TRUE' fcol_17 ) t5
on t2.fcol_10 = t5.fcol_17 or (t2.fcol_10 is null and t5.fcol_17 is null)
group by t2.fcol_7
```
> Block agg-push-down for non-equal-join
> --
>
> Key: KYLIN-5839
> URL: https://issues.apache.org/jira/browse/KYLIN-5839
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: Zhimin Wu
>Assignee: Zhimin Wu
>Priority: Major
> Fix For: 5.0.0
>
>
> The related non-equiv-join sql is as follows. If you want a corresponding
> equal-join sql, just remove the condition content `or (t2.fcol_10 is null and
> t5.fcol_17 is null)`.
> {code:java}
> select t2.fcol_7 fcol_7, count(distinct t2.fcol_6) fcol_6
> from (select t1.company_code fcol_6, t1.type_name fcol_7,
> case when t1.created_date = t0.fcol_1 then 'TRUE'
> else 'FALSE' end fcol_10
> from ( select company_code, created_date, type_name
> from "DEFAULT"."TEST_AGG_PUSH_DOWN" ) t1
> join ( select company_code, max(created_date) fcol_1
>from "DEFAULT"."TEST_AGG_PUSH_DOWN"
>group by company_code
> ) t0 on t1.company_code = t0.company_code
> ) t2 join ( select 'TRUE' fcol_17 ) t5
> on t2.fcol_10 = t5.fcol_17 or (t2.fcol_10 is null and t5.fcol_17 is null)
> group by t2.fcol_7{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5841) Upgrade org.apache.avro:avro to version 1.11.3
[ https://issues.apache.org/jira/browse/KYLIN-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836496#comment-17836496 ] ASF subversion and git services commented on KYLIN-5841: Commit 7d24ce642c1dc96f2a476408fd546d971963d5e0 in kylin's branch refs/heads/kylin5 from huangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=7d24ce642c ] KYLIN-5841 Fix vulnerability, Upgrade org.apache.avro:avro to version 1.11.3 > Upgrade org.apache.avro:avro to version 1.11.3 > -- > > Key: KYLIN-5841 > URL: https://issues.apache.org/jira/browse/KYLIN-5841 > Project: Kylin > Issue Type: Improvement > Components: Others >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Upgrade org.apache.avro:avro to version 1.11.3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5844) Refactor flat table sql ACL
[ https://issues.apache.org/jira/browse/KYLIN-5844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836497#comment-17836497 ] ASF subversion and git services commented on KYLIN-5844: Commit e804eee81eff19424ea61c6899c226ba3d5fcf59 in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=e804eee81e ] KYLIN-5844 & KYLIN-5843 Column ACL works for PushDown 1. Column ACL works for PushDown 2. Flat-table sql should consider acl > Refactor flat table sql ACL > --- > > Key: KYLIN-5844 > URL: https://issues.apache.org/jira/browse/KYLIN-5844 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > Flat-table sql should consider acl, for role_admin ignores acl -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5838) Aggregate query without aggregate function may not answered by index when computed column is used as association key
[ https://issues.apache.org/jira/browse/KYLIN-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836491#comment-17836491 ] ASF subversion and git services commented on KYLIN-5838: Commit eacb62b8aa9c23a627ec5803d18b245420222f4c in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=eacb62b8aa ] KYLIN-5838 Replace join expression with the name of computedColumn > Aggregate query without aggregate function may not answered by index when > computed column is used as association key > > > Key: KYLIN-5838 > URL: https://issues.apache.org/jira/browse/KYLIN-5838 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > In cases where there are no measures, the join key is not being correctly > replaced. The fix is quite simple; when collecting cc replacements in > SqlNode, consider the expressions in the condition for cases where there are > only group by columns present. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5816) when turn on the V3 global dictionary and concurrently build Segments, the count query result may be incorrect
[ https://issues.apache.org/jira/browse/KYLIN-5816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836482#comment-17836482 ] ASF subversion and git services commented on KYLIN-5816: Commit 2159699d8e54588d879e0ebdbb1f2ed11380bb23 in kylin's branch refs/heads/kylin5 from Yaguang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2159699d8e ] KYLIN-5816 Add zk lock for dict v3 > when turn on the V3 global dictionary and concurrently build Segments, the > count query result may be incorrect > -- > > Key: KYLIN-5816 > URL: https://issues.apache.org/jira/browse/KYLIN-5816 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > when turn on the V3 global dictionary and concurrently build Segments, the > count query result may be incorrect. > *Dev Design* > add Distributed locks for global dictionary build -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5836) MapR env Build error
[ https://issues.apache.org/jira/browse/KYLIN-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836489#comment-17836489 ] ASF subversion and git services commented on KYLIN-5836: Commit e49c2f15a645cb33a0f04a0b894af8be24613bf5 in kylin's branch refs/heads/kylin5 from Yinghao Lin [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=e49c2f15a6 ] KYLIN-5836 Fix mapr env building error > MapR env Build error > > > Key: KYLIN-5836 > URL: https://issues.apache.org/jira/browse/KYLIN-5836 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > Fix For: 5.0.0 > > > The MapR environment construction task has failed due to the default Hadoop > configuration not being loaded. > *RC* > The issue is related to the Configuration in HadoopUtil, which by default > uses the configuration files located in the KE/hadoop_conf directory. In > other environments where the configuration files are complete, there are no > issues with retrieving the required parameters. > However, in a MapR environment, the default configuration files are located > in a different directory, resulting in an incomplete conf object being > returned and causing the construction task to fail. > *Dev Design* > To address this issue, directly loading the default parameters using the > Configuration object should provide the complete configuration required for > the task to run successfully. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5809) Add discarded field for LayoutRecDetailResponse
[ https://issues.apache.org/jira/browse/KYLIN-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836477#comment-17836477 ] ASF subversion and git services commented on KYLIN-5809: Commit 630a3aa7cef2e2c36653d2d92915b01c201d1ae6 in kylin's branch refs/heads/kylin5 from lixiang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=630a3aa7ce ] KYLIN-5809 Add TableIndex suggestion control in open api > Add discarded field for LayoutRecDetailResponse > --- > > Key: KYLIN-5809 > URL: https://issues.apache.org/jira/browse/KYLIN-5809 > Project: Kylin > Issue Type: Bug >Reporter: Zhimin Wu >Assignee: Zhimin Wu >Priority: Major > > Add discarded field for LayoutRecDetailResponse -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5807) fix query execute as user without data query acl
[ https://issues.apache.org/jira/browse/KYLIN-5807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836475#comment-17836475 ] ASF subversion and git services commented on KYLIN-5807: Commit a212350a518cde5fa1fe0357a71b806f5533e2c3 in kylin's branch refs/heads/kylin5 from Zhimin Wu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a212350a51 ] KYLIN-5807 Fix query execute as user without data query acl Co-authored-by: Feng Zhu > fix query execute as user without data query acl > - > > Key: KYLIN-5807 > URL: https://issues.apache.org/jira/browse/KYLIN-5807 > Project: Kylin > Issue Type: Bug >Reporter: Zhimin Wu >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5808) Optimizing Performance When Saving Models or Adding Calculated Columns in Kylin
[ https://issues.apache.org/jira/browse/KYLIN-5808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836476#comment-17836476 ] ASF subversion and git services commented on KYLIN-5808: Commit c4aad6e78b24c36cad6ce18a2d00dfd86527be0d in kylin's branch refs/heads/kylin5 from Yaguang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=c4aad6e78b ] KYLIN-5808 Optimize performance when saving model/adding CC > Optimizing Performance When Saving Models or Adding Calculated Columns in > Kylin > --- > > Key: KYLIN-5808 > URL: https://issues.apache.org/jira/browse/KYLIN-5808 > Project: Kylin > Issue Type: Improvement >Reporter: Zhimin Wu >Priority: Major > > h3. Dev Design > Current Performance Issues in Saving Models and Adding Calculated Columns in > Kylin Engine. > # Redundant Join Operations in flat table SQL > # Optimizing Join Operations by Converting Dataset Join to Logical Plan Join -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5803) Add FileSegment and smart cache
[ https://issues.apache.org/jira/browse/KYLIN-5803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836473#comment-17836473 ] ASF subversion and git services commented on KYLIN-5803: Commit bfff6d002c9a314cd5df87ab16ff58f4a6f41fdb in kylin's branch refs/heads/kylin5 from Zhimin Wu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=bfff6d002c ] KYLIN-5803 Add file segments and smart cache - Co-authored-by: Li Yang Co-authored-by: Liu He <1044366...@qq.com> Co-authored-by: sibing.zhang > Add FileSegment and smart cache > --- > > Key: KYLIN-5803 > URL: https://issues.apache.org/jira/browse/KYLIN-5803 > Project: Kylin > Issue Type: New Feature >Reporter: Zhimin Wu >Priority: Major > > add FileSegment -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5823) improve text recognition dialog of add batch dimensions
[ https://issues.apache.org/jira/browse/KYLIN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835996#comment-17835996 ] ASF subversion and git services commented on KYLIN-5823: Commit 1d1ecbec63e0b61251cff87ad06082fa84ac8289 in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1d1ecbec63 ] KYLIN-5823,fix text recognition bug > improve text recognition dialog of add batch dimensions > --- > > Key: KYLIN-5823 > URL: https://issues.apache.org/jira/browse/KYLIN-5823 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > Attachments: image-2024-04-11-11-42-40-903.png, > image-2024-04-11-11-43-11-768.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5825) fix aggregate modal and table index modal ui and fix chrome 50 layout bug
[ https://issues.apache.org/jira/browse/KYLIN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835994#comment-17835994 ] ASF subversion and git services commented on KYLIN-5825: Commit 6adffadde703a0ee7975301eff81766fb9fcbf6e in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6adffadde7 ] KYLIN-5825,fix aggregate modal and table index modal ui and fix chrome 50 layout bug > fix aggregate modal and table index modal ui and fix chrome 50 layout bug > - > > Key: KYLIN-5825 > URL: https://issues.apache.org/jira/browse/KYLIN-5825 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > Attachments: image-2024-04-11-12-00-01-336.png, > image-2024-04-11-12-00-56-539.png, image-2024-04-11-12-02-44-264.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5824) refine handel error for export models
[ https://issues.apache.org/jira/browse/KYLIN-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835926#comment-17835926 ] ASF subversion and git services commented on KYLIN-5824: Commit 9e8ca1a9536c9ecf0eafca048c8733e3668f2c76 in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9e8ca1a953 ] KYLIN-5824,refine handel error for export models > refine handel error for export models > - > > Key: KYLIN-5824 > URL: https://issues.apache.org/jira/browse/KYLIN-5824 > Project: Kylin > Issue Type: Bug >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > > The system reports error when the number of models exceeds 256 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5823) improve text recognition dialog of add batch dimensions
[ https://issues.apache.org/jira/browse/KYLIN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835924#comment-17835924 ] ASF subversion and git services commented on KYLIN-5823: Commit 93fee7390113733c4b0c367734b953c0cc271b16 in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=93fee73901 ] KYLIN-5823,improve text recognition dialog of add batch dimensions > improve text recognition dialog of add batch dimensions > --- > > Key: KYLIN-5823 > URL: https://issues.apache.org/jira/browse/KYLIN-5823 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5826) fix table index select all issue and fix load user or usergroup list filter issue
[ https://issues.apache.org/jira/browse/KYLIN-5826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835928#comment-17835928 ] ASF subversion and git services commented on KYLIN-5826: Commit 458bddf09f85989bcac1874d3beea6d3791d3129 in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=458bddf09f ] KYLIN-5826,fix table index select all issue and fix load user or usergroup list filter issue > fix table index select all issue and fix load user or usergroup list filter > issue > - > > Key: KYLIN-5826 > URL: https://issues.apache.org/jira/browse/KYLIN-5826 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Critical > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5822) support history table adds left-closed and right-closed time interval
[ https://issues.apache.org/jira/browse/KYLIN-5822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835930#comment-17835930 ] ASF subversion and git services commented on KYLIN-5822: Commit 16f8da90718a2104729fb2a0c8d3cf61b1f8617f in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=16f8da9071 ] KYLIN-5822,support history table adds left-closed and right-closed time interval > support history table adds left-closed and right-closed time interval > - > > Key: KYLIN-5822 > URL: https://issues.apache.org/jira/browse/KYLIN-5822 > Project: Kylin > Issue Type: Bug >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5821) fix model edit page pfk flag bug and enhance model canvas window position
[ https://issues.apache.org/jira/browse/KYLIN-5821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835922#comment-17835922 ] ASF subversion and git services commented on KYLIN-5821: Commit 0d742c639c9bd690d3999c0af6d60fb549a82b8d in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0d742c639c ] KYLIN-5821,fix model edit page pfk flag bug and enhance model canvas window position > fix model edit page pfk flag bug and enhance model canvas window position > - > > Key: KYLIN-5821 > URL: https://issues.apache.org/jira/browse/KYLIN-5821 > Project: Kylin > Issue Type: Bug >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5819) optimize the warning message on the dialog for editing computed column
[ https://issues.apache.org/jira/browse/KYLIN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835920#comment-17835920 ] ASF subversion and git services commented on KYLIN-5819: Commit e734e6e31bd035c59c945ecfa99b136d2f6380b4 in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=e734e6e31b ] KYLIN-5819,optimize the warning message on the dialog for editing computed column > optimize the warning message on the dialog for editing computed column > -- > > Key: KYLIN-5819 > URL: https://issues.apache.org/jira/browse/KYLIN-5819 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Minor > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5786) Add a write lock when merging v3 dict
[ https://issues.apache.org/jira/browse/KYLIN-5786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835453#comment-17835453 ] ASF subversion and git services commented on KYLIN-5786: Commit 30c4f28a1616dc80e674c4c4f7017b6cc63114b4 in kylin's branch refs/heads/kylin5 from Yaguang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=30c4f28a16 ] KYLIN-5786 Add a write lock when merging v3 dict > Add a write lock when merging v3 dict > - > > Key: KYLIN-5786 > URL: https://issues.apache.org/jira/browse/KYLIN-5786 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5784) Optimization for query history filters
[ https://issues.apache.org/jira/browse/KYLIN-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835446#comment-17835446 ] ASF subversion and git services commented on KYLIN-5784: Commit 1367e9ccff65ece51e57c654380d526c472ed2fb in kylin's branch refs/heads/kylin5 from lixiang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1367e9ccff ] KYLIN-5784 Optimization for query history filters > Optimization for query history filters > -- > > Key: KYLIN-5784 > URL: https://issues.apache.org/jira/browse/KYLIN-5784 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > KYLIN-5763 related -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5774) Optimize Calcite plan to convert spark logical plan
[
https://issues.apache.org/jira/browse/KYLIN-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835449#comment-17835449
]
ASF subversion and git services commented on KYLIN-5774:
Commit 9db3502f80265753b38b4ecbb0ee57f7871b6466 in kylin's branch
refs/heads/kylin5 from Mingming Ge
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9db3502f80 ]
KYLIN-5774 Optimize Calcite plan to convert spark logical plan
> Optimize Calcite plan to convert spark logical plan
> ---
>
> Key: KYLIN-5774
> URL: https://issues.apache.org/jira/browse/KYLIN-5774
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0-beta
>
>
> When converting the calcite plan to spark LogicalPlan ，using the DataFrame
> interface means parsing while building the LogicalPlan.
> In this process，select, aggregation and other operators will execute the
> method below, we need care the invoking of "qe.assertAnalyzed()".
> {code:java}
> def ofRows(sparkSession: SparkSession, logicalPlan: LogicalPlan): DataFrame =
> sparkSession.withActive {
> val qe = sparkSession.sessionState.executePlan(logicalPlan)
> qe.assertAnalyzed()
> new Dataset[Row](qe, RowEncoder(qe.analyzed.schema))
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5781) Adjust the query result order of sql with union
[ https://issues.apache.org/jira/browse/KYLIN-5781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835443#comment-17835443 ] ASF subversion and git services commented on KYLIN-5781: Commit cb2a11d503f4d857b236ea62152d606d5c8d5fe7 in kylin's branch refs/heads/kylin5 from Zhiting Guo [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cb2a11d503 ] KYLIN-5781 Adjust the query result order of sql with union Co-authored-by: Zhiting Guo > Adjust the query result order of sql with union > --- > > Key: KYLIN-5781 > URL: https://issues.apache.org/jira/browse/KYLIN-5781 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > Attachments: KYLIN_5781.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5787) Use t-digest as spark percentile_approx function
[ https://issues.apache.org/jira/browse/KYLIN-5787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835448#comment-17835448 ] ASF subversion and git services commented on KYLIN-5787: Commit dd16079c42e4f6eb446945ec42980891934a20c6 in kylin's branch refs/heads/kylin5 from Zhiting Guo [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=dd16079c42 ] KYLIN-5787 Use t-digest as spark percentile_approx function > Use t-digest as spark percentile_approx function > > > Key: KYLIN-5787 > URL: https://issues.apache.org/jira/browse/KYLIN-5787 > Project: Kylin > Issue Type: Improvement > Components: Job Engine, Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Critical > Fix For: 5.0-beta > > > The underlying implementation of the percentile_approx function in KYLIN is > the open-source t-digest. > The underlying implementation of the percentile_approx function in spark is > spark's own PercentileDigest (based on QuantileSummaries). > Different implementations lead to different results. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5777) Change spark.yarn.submit.file.replication from 1 to 3
[ https://issues.apache.org/jira/browse/KYLIN-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835440#comment-17835440 ] ASF subversion and git services commented on KYLIN-5777: Commit a67e854a1d598eead4d39c10ae4295c70a94e74d in kylin's branch refs/heads/kylin5 from Yaguang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a67e854a1d ] KYLIN-5777 Change spark.yarn.submit.file.replication from 1 to 3 > Change spark.yarn.submit.file.replication from 1 to 3 > - > > Key: KYLIN-5777 > URL: https://issues.apache.org/jira/browse/KYLIN-5777 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5775) Upgrade testcontainers to version 1.16.2
[ https://issues.apache.org/jira/browse/KYLIN-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835438#comment-17835438 ] ASF subversion and git services commented on KYLIN-5775: Commit 8ab87c93b9d6e2208bffa71845270841313faf1e in kylin's branch refs/heads/kylin5 from liang.huang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8ab87c93b9 ] KYLIN-5775 upgrade testcontainers to 1.16.2 > Upgrade testcontainers to version 1.16.2 > > > Key: KYLIN-5775 > URL: https://issues.apache.org/jira/browse/KYLIN-5775 > Project: Kylin > Issue Type: Bug > Components: Others >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5788) Enhance global dict on flat table encoding stage logging & retry
[ https://issues.apache.org/jira/browse/KYLIN-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835450#comment-17835450 ] ASF subversion and git services commented on KYLIN-5788: Commit 775efe62b525a7f9188c2c478c44e57ed4b8dc48 in kylin's branch refs/heads/kylin5 from Yinghao Lin [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=775efe62b5 ] KYLIN-5788 Enhance global dict on flat table encoding stage logging & retry > Enhance global dict on flat table encoding stage logging & retry > > > Key: KYLIN-5788 > URL: https://issues.apache.org/jira/browse/KYLIN-5788 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > Attachments: pic1.jpeg, pic2.jpeg, pic3.jpeg > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5779) Without project permission，calling "kylin/api/access/acls" api occurs NPE
[ https://issues.apache.org/jira/browse/KYLIN-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835441#comment-17835441 ] ASF subversion and git services commented on KYLIN-5779: Commit 9f269b527f33911dbad4395f7e8395dc9fdbec96 in kylin's branch refs/heads/kylin5 from Liang.Hua [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=9f269b527f ] KYLIN-5779 Without project permission，API "/access/acls" throws NPE Co-authored-by: liang.hua > Without project permission，calling "kylin/api/access/acls" api occurs NPE > - > > Key: KYLIN-5779 > URL: https://issues.apache.org/jira/browse/KYLIN-5779 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5782) Duplicated join keys result empty query result
[ https://issues.apache.org/jira/browse/KYLIN-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835444#comment-17835444 ] ASF subversion and git services commented on KYLIN-5782: Commit 1b63eefbc92e570572b5e7d92ff3d9130a5dec63 in kylin's branch refs/heads/kylin5 from Zhiting Guo [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1b63eefbc9 ] KYLIN-5782 Duplicated join keys result empty query result - Co-authored-by: Zhiting Guo > Duplicated join keys result empty query result > -- > > Key: KYLIN-5782 > URL: https://issues.apache.org/jira/browse/KYLIN-5782 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5776) Support parameter type is string for timestampadd
[ https://issues.apache.org/jira/browse/KYLIN-5776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835439#comment-17835439 ] ASF subversion and git services commented on KYLIN-5776: Commit 5d781d1917ec261a95971086f8d8540afc8434fb in kylin's branch refs/heads/kylin5 from liang.huang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5d781d1917 ] KYLIN-5776 Support parameter type is string for timestampadd function > Support parameter type is string for timestampadd > - > > Key: KYLIN-5776 > URL: https://issues.apache.org/jira/browse/KYLIN-5776 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5778) Upgrade spark: parquet footer read cache
[ https://issues.apache.org/jira/browse/KYLIN-5778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835454#comment-17835454 ] ASF subversion and git services commented on KYLIN-5778: Commit 4ed37293122dc700483fceafdd085b8058a436bf in kylin's branch refs/heads/kylin5 from Yaguang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=4ed3729312 ] KYLIN-5778 Upgrade spark to 3.2.0-kylin-4.6.14.0 Add parquet footer read cache > Upgrade spark: parquet footer read cache > > > Key: KYLIN-5778 > URL: https://issues.apache.org/jira/browse/KYLIN-5778 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5783) Round query result of decimal zero by config
[ https://issues.apache.org/jira/browse/KYLIN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835445#comment-17835445 ] ASF subversion and git services commented on KYLIN-5783: Commit 8aaa87cbb3f6b9e247ced8ac34d72fb1365a39f1 in kylin's branch refs/heads/kylin5 from lixiang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8aaa87cbb3 ] KYLIN-5783 Round query result of decimal zero by config > Round query result of decimal zero by config > > > Key: KYLIN-5783 > URL: https://issues.apache.org/jira/browse/KYLIN-5783 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Minor > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5785) Support implicit query of split function
[
https://issues.apache.org/jira/browse/KYLIN-5785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835447#comment-17835447
]
ASF subversion and git services commented on KYLIN-5785:
Commit d7d80985987a344c0a49909cd8d8584829015082 in kylin's branch
refs/heads/kylin5 from Pengfei Zhan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d7d8098598 ]
KYLIN-5785 Support implicit query of split function
1. support split('aaa-bbb-ccc', '-')[0] implicit query
2. support simplify not(true/false) to false/true
> Support implicit query of split function
>
>
> Key: KYLIN-5785
> URL: https://issues.apache.org/jira/browse/KYLIN-5785
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0-beta
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5789) Clean sparder history and spark history automatically
[ https://issues.apache.org/jira/browse/KYLIN-5789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835451#comment-17835451 ] ASF subversion and git services commented on KYLIN-5789: Commit ca370d2dad5855941ebb699c1ff3d3eb343414f6 in kylin's branch refs/heads/kylin5 from sibingzhang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=ca370d2dad ] KYLIN-5789 Clean sparder history and spark history automatically > Clean sparder history and spark history automatically > - > > Key: KYLIN-5789 > URL: https://issues.apache.org/jira/browse/KYLIN-5789 > Project: Kylin > Issue Type: Bug > Components: Job Engine, Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > Attachments: KYLIN_5789.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5790) Security of kafka-clients
[ https://issues.apache.org/jira/browse/KYLIN-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835452#comment-17835452 ] ASF subversion and git services commented on KYLIN-5790: Commit 2695c5da83d9ccfb2a3177b9947e6eda4e6c1715 in kylin's branch refs/heads/kylin5 from sibingzhang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2695c5da83 ] KYLIN-5790 Security of kafka-clients Co-authored-by: sibing.zhang > Security of kafka-clients > - > > Key: KYLIN-5790 > URL: https://issues.apache.org/jira/browse/KYLIN-5790 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > |high > (8.8)|[CVE-2023-25194|https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2023-25194] > *(new)*|Deserialization of Untrusted > Data|maven:org.apache.kafka:kafka-clients@2.8.2|2023-02-07|2023-02-09|[!https://snyk.io/favicon.ico!Deserialization > of Untrusted Data in org.apache.kafka:kafka-clients \| CVE-2023-25194 \| > Snyk|https://snyk.io/vuln/SNYK-JAVA-ORGAPACHEKAFKA-3317161]| > Note: The vulnerability had only a snyk rating: medium - snyk (5.6), now the > NVD rating is high (8.8). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5780) Dimension capacity does not work
[ https://issues.apache.org/jira/browse/KYLIN-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835442#comment-17835442 ] ASF subversion and git services commented on KYLIN-5780: Commit 8929bb820c881e7172eddbc5f6606d04f62a0dd3 in kylin's branch refs/heads/kylin5 from Hang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8929bb820c ] KYLIN-5780 Dimension capacity of aggGroup does not work > Dimension capacity does not work > > > Key: KYLIN-5780 > URL: https://issues.apache.org/jira/browse/KYLIN-5780 > Project: Kylin > Issue Type: Bug > Components: Modeling >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > The setting of the maximum number of dimension combinations at the bottom of > the aggregation group does not take effect. > When editing an aggregation group, set the maximum number of dimension > combinations at the bottom (applicable to aggregation groups that do not have > a maximum number of dimension combinations set) to 1. After saving, when > editing again, it becomes unlimited. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5820) added pagination and add count distinct function in batch measure dialog
[ https://issues.apache.org/jira/browse/KYLIN-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835098#comment-17835098 ] ASF subversion and git services commented on KYLIN-5820: Commit f6cc0ce32c82e3102a2fe27db9c3b9a99f43bd47 in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=f6cc0ce32c ] KYLIN-5820,added pagination and add count distinct function in batch measure dialog > added pagination and add count distinct function in batch measure dialog > - > > Key: KYLIN-5820 > URL: https://issues.apache.org/jira/browse/KYLIN-5820 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Critical > Fix For: 5.0.0 > > Attachments: image-2024-04-09-09-54-05-858.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5813) improve query history page filter item and model list page button text
[ https://issues.apache.org/jira/browse/KYLIN-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17835096#comment-17835096 ] ASF subversion and git services commented on KYLIN-5813: Commit 8c91a1a4eddbf0ed29f0e81487ea1e088cbf736b in kylin's branch refs/heads/kylin5 from huangchunyan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8c91a1a4ed ] KYLIN-5813,improve query history page filter item and model list page button text > improve query history page filter item and model list page button text > -- > > Key: KYLIN-5813 > URL: https://issues.apache.org/jira/browse/KYLIN-5813 > Project: Kylin > Issue Type: Improvement >Reporter: chunyan.huang >Assignee: chunyan.huang >Priority: Major > Fix For: 5.0.0 > > Attachments: image-2024-04-09-09-38-42-450.png, > image-2024-04-09-09-39-13-571.png, image-2024-04-09-09-39-40-593.png, > image-2024-04-09-09-44-16-515.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5771) Query cannot be interrupted during Segment pruning phase
[ https://issues.apache.org/jira/browse/KYLIN-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832729#comment-17832729 ] ASF subversion and git services commented on KYLIN-5771: Commit 64b52dea660fc5feba34b8650557f1323d55b28b in kylin's branch refs/heads/kylin5 from fengguangyuan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=64b52dea66 ] KYLIN-5771 Query cannot be interrupted during segment pruning Co-authored-by: Guangyuan Feng > Query cannot be interrupted during Segment pruning phase > > > Key: KYLIN-5771 > URL: https://issues.apache.org/jira/browse/KYLIN-5771 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > > When SQL is in the planning stage and pruning segment optimization is > performed, it may cause the query to cross the expected 300s and trigger the > timeout cancellation logic due to the existence of a large number of > segments, and a large number of filter expressions for simplification issues. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5766) Normalize query cache key
[ https://issues.apache.org/jira/browse/KYLIN-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832723#comment-17832723 ] ASF subversion and git services commented on KYLIN-5766: Commit a8ad269b3c37d8670f0c5205ecef9d60a2796df3 in kylin's branch refs/heads/kylin5 from lixiang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=a8ad269b3c ] KYLIN-5766 Normalize query cache key > Normalize query cache key > - > > Key: KYLIN-5766 > URL: https://issues.apache.org/jira/browse/KYLIN-5766 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5769) Support split function
[ https://issues.apache.org/jira/browse/KYLIN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832727#comment-17832727 ] ASF subversion and git services commented on KYLIN-5769: Commit 738cf4af01fca030751eaff0b1ea3a59340d83eb in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=738cf4af01 ] KYLIN-5769 Support split function > Support split function > -- > > Key: KYLIN-5769 > URL: https://issues.apache.org/jira/browse/KYLIN-5769 > Project: Kylin > Issue Type: Improvement > Components: Job Engine, Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5768) Refine some code for localcache
[ https://issues.apache.org/jira/browse/KYLIN-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832726#comment-17832726 ] ASF subversion and git services commented on KYLIN-5768: Commit 60da9e0ce1fa789ad580ca62ae4d47162f9d3201 in kylin's branch refs/heads/kylin5 from Yinghao Lin [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=60da9e0ce1 ] KYLIN-5768 Refine and adjust some code for localCache - Co-authored-by: sibingzhang <74443791+sibingzh...@users.noreply.github.com> Co-authored-by: sibing.zhang > Refine some code for localcache > --- > > Key: KYLIN-5768 > URL: https://issues.apache.org/jira/browse/KYLIN-5768 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5770) Update spring-security-config from 5.7.8 to 5.7.10
[ https://issues.apache.org/jira/browse/KYLIN-5770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832728#comment-17832728 ] ASF subversion and git services commented on KYLIN-5770: Commit 3dd581ecfa47477892da5590d168ccf6b28e5f13 in kylin's branch refs/heads/kylin5 from jlf [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3dd581ecfa ] KYLIN-5770 Upgrade spring-security-config from 5.7.8 from 5.7.10 > Update spring-security-config from 5.7.8 to 5.7.10 > -- > > Key: KYLIN-5770 > URL: https://issues.apache.org/jira/browse/KYLIN-5770 > Project: Kylin > Issue Type: Bug > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5763) Very slow to filter query history
[
https://issues.apache.org/jira/browse/KYLIN-5763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832719#comment-17832719
]
ASF subversion and git services commented on KYLIN-5763:
Commit 71a7a52d669f3c33b6efd7f9bbc80a5b1dfd894a in kylin's branch
refs/heads/kylin5 from lixiang
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=71a7a52d66 ]
KYLIN-5763 Fix query history model filter
> Very slow to filter query history
> -
>
> Key: KYLIN-5763
> URL: https://issues.apache.org/jira/browse/KYLIN-5763
> Project: Kylin
> Issue Type: Bug
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0-beta
>
>
> If there are many queryHistory records,
> 1) filtering them by query object is very slow;
> 2) searching them by key(the model name) cannot work.
>
> However, executing query in mysql, the result responses very fast.
> {code:sql}
> select distinct model from kylin_query_history_realization
> where project_name = "abc";
> select distinct engine_type from kylin_query_history where engine_type <>
> 'NATIVE' and project_name = "abc";
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5767) Calculating total rows abnormal when jdbc datasource is connnected
[
https://issues.apache.org/jira/browse/KYLIN-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832724#comment-17832724
]
ASF subversion and git services commented on KYLIN-5767:
Commit d3b4469484a79102071db26114f6602b30d70f43 in kylin's branch
refs/heads/kylin5 from Liang.Hua
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d3b4469484 ]
KYLIN-5767 Calculate total rows wrongly when connecting jdbc datasource
-
Co-authored-by: liang.hua
> Calculating total rows abnormal when jdbc datasource is connnected
> --
>
> Key: KYLIN-5767
> URL: https://issues.apache.org/jira/browse/KYLIN-5767
> Project: Kylin
> Issue Type: Bug
> Components: Job Engine
>Affects Versions: 5.0-beta
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0.0
>
>
> {{When the JDBC data source is connected, the snapshot management function is
> enabled and the dimension table is not sampled, optimize the build logic to
> ensure that the job can be executed normally when the dimension table data
> volume is large}}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5757) No way to deselect query objects after selecting all of them on this page
[ https://issues.apache.org/jira/browse/KYLIN-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832718#comment-17832718 ] ASF subversion and git services commented on KYLIN-5757: Commit d977ce7bfc9a244d7dbb568ba75a58ab29648908 in kylin's branch refs/heads/kylin5 from Hang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d977ce7bfc ] KYLIN-5757 No way to deselect query objects after selecting all of them > No way to deselect query objects after selecting all of them on this page > - > > Key: KYLIN-5757 > URL: https://issues.apache.org/jira/browse/KYLIN-5757 > Project: Kylin > Issue Type: Improvement > Components: Others >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > The API of listing models very slow at sometime, improve it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5772) Fix vlunerability and excluding ekio
[ https://issues.apache.org/jira/browse/KYLIN-5772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832730#comment-17832730 ] ASF subversion and git services commented on KYLIN-5772: Commit 90aa1def3d0bd2c1b2f6548923d9bde8af0d6cee in kylin's branch refs/heads/kylin5 from Yinghao Lin [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=90aa1def3d ] KYLIN-5772 Fix vulnerability & excluding okio > Fix vlunerability and excluding ekio > > > Key: KYLIN-5772 > URL: https://issues.apache.org/jira/browse/KYLIN-5772 > Project: Kylin > Issue Type: Bug > Components: Others >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5773) Upgrade Spark to 4.6.13.0
[ https://issues.apache.org/jira/browse/KYLIN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832731#comment-17832731 ] ASF subversion and git services commented on KYLIN-5773: Commit ad52aada8fb7a5b1620b076680ea48bfecb5e919 in kylin's branch refs/heads/kylin5 from huangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=ad52aada8f ] KYLIN-5773 update spark version to 3.2.0-kylin-4.6.13.0 > Upgrade Spark to 4.6.13.0 > - > > Key: KYLIN-5773 > URL: https://issues.apache.org/jira/browse/KYLIN-5773 > Project: Kylin > Issue Type: Bug > Components: Spark Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5764) Sum expression supports if condition
[ https://issues.apache.org/jira/browse/KYLIN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832721#comment-17832721 ] ASF subversion and git services commented on KYLIN-5764: Commit cd09148868fd2b4cb5a08d236e1a0c0e8dd5eaea in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=cd09148868 ] KYLIN-5764 Sum expression supports if condition > Sum expression supports if condition > > > Key: KYLIN-5764 > URL: https://issues.apache.org/jira/browse/KYLIN-5764 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5765) Optimization of registering udf operators
[ https://issues.apache.org/jira/browse/KYLIN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832722#comment-17832722 ] ASF subversion and git services commented on KYLIN-5765: Commit b7615c56bb618fc1133d156d12df9fd00ea04a2d in kylin's branch refs/heads/kylin5 from Mingming Ge [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=b7615c56bb ] KYLIN-5765 Optimization of registering udf operators > Optimization of registering udf operators > - > > Key: KYLIN-5765 > URL: https://issues.apache.org/jira/browse/KYLIN-5765 > Project: Kylin > Issue Type: Improvement > Components: Query Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0.0 > > Attachments: 42118-2.png, 42118.png > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5745) The historical garbage cleanup task was not completed, causing the subsequent scheduled garbage cleanup task cannot be executed normally
[
https://issues.apache.org/jira/browse/KYLIN-5745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832725#comment-17832725
]
ASF subversion and git services commented on KYLIN-5745:
Commit 180ff07afeaf64da8e565b7aa5882c3a89f1c268 in kylin's branch
refs/heads/kylin5 from fengguangyuan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=180ff07afe ]
KYLIN-5745 Using a global thread pool to clean underlying storages
1. Using a global thread pool to clean underlying storages;
2. Launching cleaning tasks in the local thread and to ignore
FileNotFoundException while collecting HDFS files.
Co-authored-by: Guangyuan Feng
> The historical garbage cleanup task was not completed, causing the subsequent
> scheduled garbage cleanup task cannot be executed normally
>
>
> Key: KYLIN-5745
> URL: https://issues.apache.org/jira/browse/KYLIN-5745
> Project: Kylin
> Issue Type: Bug
>Affects Versions: 5.0-beta
>Reporter: zhong.zhu
>Assignee: zhong.zhu
>Priority: Major
> Fix For: 5.0.0
>
>
> {*}Problem description{*}:
> Timed garbage cleanup operation cannot be completed successfully
> {*}Background{*}:
> The customer found that Kylin has a large number of small files occupying
> hdfs storage, we need to clean up, we check the customer's environment and
> found that the timed garbage cleanup has not been completed properly, has
> been timeout!
> *Troubleshooting:*
> After the check, it is found that the customer's garbage clearing is
> triggered for the first time in the morning of 4.6 after Kylin is restarted
> on the night of 4.5. After this clearing operation is triggered, the thread
> of query history has been deleted since then. As a result, subsequent
> periodic garbage clearing tasks cannot be completed
> Delete 2,000 rows of data at a time, one of the customer's projects need to
> delete 550,000 query history, look at the kylin.log record, delete
> time-consuming because of table locking problems lead to a delete operation
> even reached more than 20 minutes!
> The following record is that the main thread of garbage collection is waiting
> for the query history cleaning to complete, but the query history cleaning
> has not been completed, and then the main thread timeout and exit.
> {code:shell}
> 2023-04-06T00:00:00,015 INFO [RoutineOpsWorker-287] service.ScheduleService
> : execute task MetadataBackup with remaining time: 1435 ms
> 2023-04-06T00:01:52,649 INFO [RoutineOpsWorker-287] service.ScheduleService
> : execute task QueryHistoriesCleanup with remaining time: 14287361 ms
> ...
> 2023-04-06T04:00:00,012 WARN [DefaultTaskScheduler-3]
> service.ScheduleService : Routine task execution timeout
> java.util.concurrent.TimeoutException: null
> at java.util.concurrent.FutureTask.get(FutureTask.java:205)
> ~[?:1.8.0_242]
> at
> org.apache.kylin.rest.service.ScheduleService.executeTask(ScheduleService.java:107)
> ~[kylin-job-service-5.0.0-ke-4.6.2.0.jar:?]
> at
> org.apache.kylin.rest.service.ScheduleService.routineTask(ScheduleService.java:77)
> ~[kylin-job-service-5.0.0-ke-4.6.2.0.jar:?]
> at
> org.apache.kylin.rest.service.ScheduleService$$FastClassBySpringCGLIB$$afbfc46c.invoke()
> ~[kylin-job-service-5.0.0-ke-4.6.2.0.jar:?]
> {code}
> The following record is until the latest time provided by the log, after 9:00
> pm the query history is still processing deletion, not with the termination
> of the main thread
> {code:shell}
> 2023-04-06T00:08:43,015 DEBUG [QueryHistoryCleanWorker-23145]
> QueryHistoryMapper.selectByProject : <== Total: 12
> 2023-04-06T00:08:43,016 INFO [QueryHistoryCleanWorker-23145]
> util.QueryHisStoreUtil : Query histories of project is less than
> the maximum limit, so skip it.
> 2023-04-06T00:08:43,016 INFO [QueryHistoryCleanWorker-23145]
> util.QueryHisStoreUtil : Query histories of project is less than the
> maximum limit, so skip it.
> 2023-04-06T00:08:43,016 INFO [QueryHistoryCleanWorker-23145]
> util.QueryHisStoreUtil : Query histories of project is less than the
> maximum limit, so skip it.
> 2023-04-06T00:08:43,016 INFO [QueryHistoryCleanWorker-23145]
> util.QueryHisStoreUtil : Query histories of project is less than the
> maximum limit, so skip it.
> 2023-04-06T00:08:43,017 INFO [QueryHistoryCleanWorker-23145]
> util.QueryHisStoreUtil : Start to delete query histories that are beyond max
> size for project, records:1551669
> ...
> 2023-04-06T09:03:54,974 INFO [QueryHistoryCleanWorker-23145]
> query.JdbcQueryHistoryStore : Delete 2000 row query history for project
> [CXCZH] takes 938060 ms
> 2023-04-06T09:03:54,975 DEBUG [QueryHistoryCleanWorker-23145]
>
[jira] [Commented] (KYLIN-5759) Log governance of job building log
[ https://issues.apache.org/jira/browse/KYLIN-5759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832720#comment-17832720 ] ASF subversion and git services commented on KYLIN-5759: Commit 046c97f54c5fa582f8983c794bf0d5a4a0cfd15e in kylin's branch refs/heads/kylin5 from jlf [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=046c97f54c ] KYLIN-5759 Log governance of job building log 1. move build log in kylin.build.log 2. add LogConstant.SMART_CATEGORY > Log governance of job building log > -- > > Key: KYLIN-5759 > URL: https://issues.apache.org/jira/browse/KYLIN-5759 > Project: Kylin > Issue Type: Improvement > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > Improve the log governance. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5762) Initialize job scheduler encounters NPE
[ https://issues.apache.org/jira/browse/KYLIN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832156#comment-17832156 ] ASF subversion and git services commented on KYLIN-5762: Commit 1d665a82829a82fc9a51181378aa87de1a98dea2 in kylin's branch refs/heads/kylin5 from huangsheng [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=1d665a8282 ] KYLIN-5762 Initialize job scheduler encounters NPE > Initialize job scheduler encounters NPE > --- > > Key: KYLIN-5762 > URL: https://issues.apache.org/jira/browse/KYLIN-5762 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > Given `kylin.job.max-concurrent-jobs=0`, the initialization of job scheduler > encounters NPE. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5740) Equivalent aggregations matches index failed when using the strategy of dimension as measure.
[
https://issues.apache.org/jira/browse/KYLIN-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832157#comment-17832157
]
ASF subversion and git services commented on KYLIN-5740:
Commit 0e3354414d89c4b4b81d0ec1db8d39705e760a40 in kylin's branch
refs/heads/kylin5 from huangsheng
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=0e3354414d ]
KYLIN-5740 Equivalent aggregations matches index failed
Equivalent aggregations matches index failed when using
the strategy of dimension as measure.
> Equivalent aggregations matches index failed when using the strategy of
> dimension as measure.
> -
>
> Key: KYLIN-5740
> URL: https://issues.apache.org/jira/browse/KYLIN-5740
> Project: Kylin
> Issue Type: Bug
>Affects Versions: 5.0-beta
>Reporter: zhong.zhu
>Assignee: zhong.zhu
>Priority: Critical
> Fix For: 5.0.0
>
> Attachments: image-2023-12-11-14-25-14-409.png,
> image-2023-12-11-14-32-11-954.png, image-2023-12-11-14-36-45-263.png,
> image-2023-12-11-14-37-08-556.png
>
>
> Reproduction method:
> Table Building Statements
> {code:sql}
> CREATE EXTERNAL TABLE LT859 (
> `PRO_MT_SEASON` varchar(4096),
> `ARRIVAL_TRANSIT_IN_PRM_AMT` decimal(18,4),
> `BIG_REGION_NAME` varchar(4096),
> `REGION_NAME` varchar(4096)
> ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
> STORED AS TEXTFILE;LOAD DATA INPATH '/path/to/data/LT859.csv' OVERWRITE INTO
> TABLE LT859;
> {code}
> Data（LT859.csv）
> {code:bash}
> 22Q1,150.12,东区,华东区
> 22Q2,200.59,中区,华中区
> 22Q3,301.55,上海区,华东区
> {code}
> Select SQL:
> {code:sql}
> select
> max(BIG_REGION_NAME) "max1",
> max(
> case when 1=1 then "BIG_REGION_NAME"
> end
> ) "max2"
> from XXX.LT859
> {code}
> Create model, dimension 4 columns selected, add metrics MAX(BIG_REGION_NAME)
> Save the model and delete the base aggregation index, manually add an
> aggregation group as a replacement for the base aggregation, but it can't
> have the MAX(BIG_REGION_NAME) metric in it to mimic the dim as measure
> scenario, and build the full amount.
> Using the above select sql query, you can see that NPE is reported in the
> background:
> !image-2023-12-11-14-25-14-409.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5744) Enable the parameter kylin.query.using-metadata-answer-minmax-of-dimension by default, to answer the max/min query through metadata
[ https://issues.apache.org/jira/browse/KYLIN-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832162#comment-17832162 ] ASF subversion and git services commented on KYLIN-5744: Commit d13199db7407552226a58060ceb9b41a7f859c36 in kylin's branch refs/heads/kylin5 from Pengfei Zhan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d13199db74 ] KYLIN-5744 Answering snapshot first, then answering by metadata Hitting snapshot has a higher priority than answering min/max with metadata. Change the default behavior of routing query to metadata to true 1. Fix timezone problem. Given the fact of min(cal_dt) = '2012-01-01', the result of `select min(cal_dt) from test_kylin_fact` may give '2011-12-31' rather than '2012-01-01'. 2. Fix min/max query hit a index without any dimensions. For example: `select min(cal_dt) as min_cal_dt from test_kylin_fact ` hits index just has a measure of min(cal_dt), the SparkPlan is wrong: ` project --- project --- tableScan `; but the desired SparkPlan is: ` aggregate --- project --- tableScan `. > Enable the parameter kylin.query.using-metadata-answer-minmax-of-dimension by > default, to answer the max/min query through metadata > --- > > Key: KYLIN-5744 > URL: https://issues.apache.org/jira/browse/KYLIN-5744 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Minor > Fix For: 5.0.0 > > > Enable the parameter > *_kylin.query.using-metadata-answer-minmax-of-dimension_* by default to > answer max/min queries via metadata -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5747) Calcite constant folding, adding strings to numbers, results not as expected when multiple plus signs are used together
[ https://issues.apache.org/jira/browse/KYLIN-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832161#comment-17832161 ] ASF subversion and git services commented on KYLIN-5747: Commit 572d78a45b6e0cabb248b6772a9b434221d9f323 in kylin's branch refs/heads/kylin5 from Zhiting Guo [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=572d78a45b ] KYLIN-5756 Concat string and number with + gives unexpected result KYLIN-5747 duplicated Co-authored-by: Zhiting Guo > Calcite constant folding, adding strings to numbers, results not as expected > when multiple plus signs are used together > --- > > Key: KYLIN-5747 > URL: https://issues.apache.org/jira/browse/KYLIN-5747 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Critical > Fix For: 5.0.0 > > > Phenomenon: > When more than one plus sign is used in a row and the parameters on both > sides of the plus sign are constants, the result is not as expected > '1' + 3 + 3 → 7 (correct) > '1' + 3 + '3' → 4.03 (wrong result) > '1' + '3' + 'a' → error > When multiple plus signs are used in a row, and the arguments on both sides > of the plus sign are constants, and the first plus sign results in null, the > use of plus signs in a row is not supported. > e.g. 'q' + 1 + 1 -> error -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5760) Support matching model exactly for list jobs
[ https://issues.apache.org/jira/browse/KYLIN-5760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832153#comment-17832153 ] ASF subversion and git services commented on KYLIN-5760: Commit b15367e3e2682b195966f5b59dbf09f8867a792e in kylin's branch refs/heads/kylin5 from Hang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=b15367e3e2 ] KYLIN-5760 Support matching model exactly for list jobs > Support matching model exactly for list jobs > > > Key: KYLIN-5760 > URL: https://issues.apache.org/jira/browse/KYLIN-5760 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > h1. Description > At present the API of list jobs (/kylin/api/jobs) will return all job lists > that fuzzy match the given key. Sometimes, for better performance, the key is > applied to match jobs exactly, however, it's not supported yet. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5762) Initialize job scheduler encounters NPE
[ https://issues.apache.org/jira/browse/KYLIN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832152#comment-17832152 ] ASF subversion and git services commented on KYLIN-5762: Commit 6816947de43cc1f3a7101c06a1d32d623a36ef06 in kylin's branch refs/heads/kylin5 from sibingzhang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6816947de4 ] KYLIN-5762 Initialize job scheduler encounters NPE Co-authored-by: sibing.zhang > Initialize job scheduler encounters NPE > --- > > Key: KYLIN-5762 > URL: https://issues.apache.org/jira/browse/KYLIN-5762 > Project: Kylin > Issue Type: Bug > Components: Job Engine >Affects Versions: 5.0-beta >Reporter: pengfei.zhan >Assignee: pengfei.zhan >Priority: Major > Fix For: 5.0-beta > > > Given `kylin.job.max-concurrent-jobs=0`, the initialization of job scheduler > encounters NPE. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5741) When using the API in project settings API to update the linking relationship between projects and job engines, an error is reported when the projects parameter is empt
[ https://issues.apache.org/jira/browse/KYLIN-5741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832158#comment-17832158 ] ASF subversion and git services commented on KYLIN-5741: Commit 7cd3fd0ecc8ce95ef4f21a84abd1ed251d4e54a4 in kylin's branch refs/heads/kylin5 from Yu Gan [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=7cd3fd0ecc ] KYLIN-5741 change all epoch when empty projects request > When using the API in project settings API to update the linking relationship > between projects and job engines, an error is reported when the projects > parameter is empty > - > > Key: KYLIN-5741 > URL: https://issues.apache.org/jira/browse/KYLIN-5741 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Critical > Fix For: 5.0.0 > > Attachments: image-2023-12-11-14-44-04-923.png > > > !image-2023-12-11-14-44-04-923.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5742) When the "Group by" group has duplicate values, the result of Grouping Set query is inconsistent with that in SparkSQL
[
https://issues.apache.org/jira/browse/KYLIN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832155#comment-17832155
]
ASF subversion and git services commented on KYLIN-5742:
Commit c396134127b17e741e6ead1197589afe7bb773d7 in kylin's branch
refs/heads/kylin5 from fengguangyuan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=c396134127 ]
KYLIN-5742 Make the query result of duplicate group sets same as Spark
Co-authored-by: Guangyuan Feng
> When the "Group by" group has duplicate values, the result of Grouping Set
> query is inconsistent with that in SparkSQL
> --
>
> Key: KYLIN-5742
> URL: https://issues.apache.org/jira/browse/KYLIN-5742
> Project: Kylin
> Issue Type: Bug
>Affects Versions: 5.0-beta
>Reporter: zhong.zhu
>Assignee: zhong.zhu
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: image-2023-12-11-14-54-38-652.png,
> image-2023-12-11-14-55-46-222.png, image-2023-12-11-14-57-32-037.png,
> image-2023-12-11-14-57-56-771.png
>
>
> {code:sql}
> -- sql1
> select C_NAME,C_CITY,C_NATION,C_REGION,count(*)
> FROM SSB.LINEORDER as LINEORDER
> INNER JOIN SSB.CUSTOMER as CUSTOMER
> ON LINEORDER.LO_CUSTKEY = CUSTOMER.C_CUSTKEY
> where C_NATION = 'CHINA' and C_CITY = 'CHINA 0'
> group by
> GROUPING SETS ((),(C_NAME,C_CITY),(C_NATION,C_REGION))
> order by C_NAME;
> -- sql2
> select C_NAME,C_CITY,C_NATION,C_REGION,count(*)
> FROM SSB.LINEORDER as LINEORDER
> INNER JOIN SSB.CUSTOMER as CUSTOMER
> ON LINEORDER.LO_CUSTKEY = CUSTOMER.C_CUSTKEY
> where C_NATION = 'CHINA' and C_CITY = 'CHINA 0'
> group by
> C_NAME,C_CITY,C_NATION,C_REGION,
> GROUPING SETS ((),(C_NAME,C_CITY),(C_NATION,C_REGION))
> order by C_NAME;
> -- sql3
> select C_NAME,C_CITY,C_NATION,C_REGION,count(*)
> FROM SSB.LINEORDER as LINEORDER
> INNER JOIN SSB.CUSTOMER as CUSTOMER
> ON LINEORDER.LO_CUSTKEY = CUSTOMER.C_CUSTKEY
> where C_NATION = 'CHINA' and C_CITY = 'CHINA 0'
> group by
> C_NAME,C_CITY,C_NATION,C_REGION
> GROUPING SETS ((),(C_NAME,C_CITY),(C_NATION,C_REGION))
> order by C_NAME
> {code}
> In spark-sql, sql1 and sql3 query results are consistent as follows:
> !image-2023-12-11-14-54-38-652.png!
> In spark-sql, sql 2 the query results are as follows.
> !image-2023-12-11-14-55-46-222.png!
> In KYLIN, the query result of sql1 is as follows, which is consistent with
> the result of spark-sql sql sql1 sql2:
> !image-2023-12-11-14-57-32-037.png!
> The query result of sql2 is as follows, which is inconsistent with the
> spark-sql sql2 result:
> !image-2023-12-11-14-57-56-771.png!
> The syntax of sql3 is not supported
> Hive does not support commas before grouping sets, that is, sql2 is not
> supported, and the query results of sql1 and sql3 are consistent with
> spark-sql
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5756) Concat string and number with '+' gives unexpected result
[
https://issues.apache.org/jira/browse/KYLIN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832160#comment-17832160
]
ASF subversion and git services commented on KYLIN-5756:
Commit 572d78a45b6e0cabb248b6772a9b434221d9f323 in kylin's branch
refs/heads/kylin5 from Zhiting Guo
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=572d78a45b ]
KYLIN-5756 Concat string and number with + gives unexpected result
KYLIN-5747 duplicated
Co-authored-by: Zhiting Guo
> Concat string and number with '+' gives unexpected result
> -
>
> Key: KYLIN-5756
> URL: https://issues.apache.org/jira/browse/KYLIN-5756
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
>Affects Versions: 5.0-beta
>Reporter: pengfei.zhan
>Assignee: pengfei.zhan
>Priority: Major
> Fix For: 5.0-beta
>
>
> Concat string and number gives unexpected result.
> For example:
> 1. concat constant with plus operator, gives unexpected result
> {code:java}
> 1' + 3 + 3 // 7 (correct)
> '1' + 3 + '3' // 4.03 (wrong result)
> '1' + '3' + 'a' // error
> {code}
> 2. concat string and number, the first '+' produces null
> {code:java}
> 'q' + 1 + 1 // error
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5746) On the page, select online model operation offline, click the model online again, and put the model online button into ash.
[ https://issues.apache.org/jira/browse/KYLIN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832164#comment-17832164 ] ASF subversion and git services commented on KYLIN-5746: Commit 3cbcead2ed5cb3046647ef2a6617c9480254b1b9 in kylin's branch refs/heads/kylin5 from liang.huang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3cbcead2ed ] KYLIN-5746 model list get optimize fix > On the page, select online model operation offline, click the model online > again, and put the model online button into ash. > --- > > Key: KYLIN-5746 > URL: https://issues.apache.org/jira/browse/KYLIN-5746 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Blocker > Fix For: 5.0.0 > > Attachments: image-2023-12-11-17-33-31-889.png > > > Repeat step: > 1:Create model, build data, model for online. > 2:Operate the model offline > 3:Click on the model again and select the model to go online. > Actual result > The model on-line button is grayed out, indicating that the model is not > available for on-line operation. > !image-2023-12-11-17-33-31-889.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5741) When using the API in project settings API to update the linking relationship between projects and job engines, an error is reported when the projects parameter is empt
[ https://issues.apache.org/jira/browse/KYLIN-5741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832163#comment-17832163 ] ASF subversion and git services commented on KYLIN-5741: Commit 227e7a068360978133f8188cff859723cea458bf in kylin's branch refs/heads/kylin5 from zhong.zhu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=227e7a0683 ] KYLIN-5741 punctuation optimized > When using the API in project settings API to update the linking relationship > between projects and job engines, an error is reported when the projects > parameter is empty > - > > Key: KYLIN-5741 > URL: https://issues.apache.org/jira/browse/KYLIN-5741 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Critical > Fix For: 5.0.0 > > Attachments: image-2023-12-11-14-44-04-923.png > > > !image-2023-12-11-14-44-04-923.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5743) Set kylin.query.convert-sum-expression-enabled=true, fail to completely hit the aggregate index when the query contains sum (case when) expressions
[
https://issues.apache.org/jira/browse/KYLIN-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832159#comment-17832159
]
ASF subversion and git services commented on KYLIN-5743:
Commit 553219830193ec43f7b6d68fe626b04456633120 in kylin's branch
refs/heads/kylin5 from Pengfei Zhan
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5532198301 ]
KYLIN-5743 optimization of SumExpression prevents ProjectJoinTransposeRule to
hit AggIndex
> Set kylin.query.convert-sum-expression-enabled=true, fail to completely hit
> the aggregate index when the query contains sum (case when) expressions
> ---
>
> Key: KYLIN-5743
> URL: https://issues.apache.org/jira/browse/KYLIN-5743
> Project: Kylin
> Issue Type: Bug
>Affects Versions: 5.0-beta
>Reporter: zhong.zhu
>Assignee: zhong.zhu
>Priority: Major
> Fix For: 5.0.0
>
>
> {code:sql}
> select
> sum(
> case
> when LO_COMMITDATE = '20230501' then LO_DISCOUNT
> end
> )
> from
> (
> select
> LO_COMMITDATE,
> LO_DISCOUNT,
> LINEORDER.LO_ORDERDATE
> from
> ssb.LINEORDER
> ) a
> where
> LO_COMMITDATE = (
> select
> max(LO_COMMITDATE)
> from
> ssb.LINEORDER
> )
> LIMIT
> 500
> {code}
> Fix the sum case when in this scenario so that it hits aggregated indexes
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (KYLIN-5733) Export model TDS file in English interface, including Chinese when opening the file in text mode
[ https://issues.apache.org/jira/browse/KYLIN-5733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832151#comment-17832151 ] ASF subversion and git services commented on KYLIN-5733: Commit 387e68d0a669b84d269341a8a4127c5b70d6bf55 in kylin's branch refs/heads/kylin5 from fanfanAlice [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=387e68d0a6 ] KYLIN-5733 TDS template modify to English > Export model TDS file in English interface, including Chinese when opening > the file in text mode > > > Key: KYLIN-5733 > URL: https://issues.apache.org/jira/browse/KYLIN-5733 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Critical > Fix For: 5.0.0 > > > *Steps to reproduce the issue:* > # Go to a model and click “Export TDS”. > # Open up the file in a text editor and look at the bottom. There are > Chinese characters. See attachment. > I confirmed this issue is present in 4.5.4 and .11, and likely exists in > other versions. The TDS file seems to work fine though. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5732) High-level security vulnerabilities:maven:org.xerial.snappy:snappy-java@1.1.8.4/CVE-2023-34455
[ https://issues.apache.org/jira/browse/KYLIN-5732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17832150#comment-17832150 ] ASF subversion and git services commented on KYLIN-5732: Commit 3ec3063135f6b99cb4f7934d056a6ca7fd4a1e5e in kylin's branch refs/heads/kylin5 from Yinghao Lin [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3ec3063135 ] KYLIN-5732 Upgrade snappy-java to fix vulnerabilities > High-level security > vulnerabilities:maven:org.xerial.snappy:snappy-java@1.1.8.4/CVE-2023-34455 > -- > > Key: KYLIN-5732 > URL: https://issues.apache.org/jira/browse/KYLIN-5732 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: zhong.zhu >Assignee: zhong.zhu >Priority: Critical > Fix For: 5.0.0 > > Attachments: image-2023-12-05-19-01-48-480.png > > > Vulnerability Details: > !image-2023-12-05-19-01-48-480.png! > snyk link: [https://snyk.io/vuln/SNYK-JAVA-ORGXERIALSNAPPY-5710960] > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5683) There is a pagination problem when table data is in integer columns
[ https://issues.apache.org/jira/browse/KYLIN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796037#comment-17796037 ] ASF subversion and git services commented on KYLIN-5683: Commit 8118afb44988b9bda4723689997e6e045c1053be in kylin's branch refs/heads/kylin5 from Qian Xia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8118afb449 ] KYLIN-5683 tree list load more columns issue > There is a pagination problem when table data is in integer columns > --- > > Key: KYLIN-5683 > URL: https://issues.apache.org/jira/browse/KYLIN-5683 > Project: Kylin > Issue Type: Bug >Reporter: Laura Xia >Assignee: Laura Xia >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5682) ER graph optimizes performance
[ https://issues.apache.org/jira/browse/KYLIN-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796035#comment-17796035 ] ASF subversion and git services commented on KYLIN-5682: Commit 2067e8d6413002234fd171edfccaea7cbc92cd3b in kylin's branch refs/heads/kylin5 from Qian Xia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2067e8d641 ] KYLIN-5682 er graph column pagination issue > ER graph optimizes performance > -- > > Key: KYLIN-5682 > URL: https://issues.apache.org/jira/browse/KYLIN-5682 > Project: Kylin > Issue Type: Improvement >Reporter: Laura Xia >Assignee: Laura Xia >Priority: Major > Fix For: 5.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[
https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795146#comment-17795146
]
ASF subversion and git services commented on KYLIN-5730:
Commit 3c8f2d2f0211fee84180669394844c7a49a62c87 in kylin's branch
refs/heads/kylin5-release from Xiaoxiang Yu
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=3c8f2d2f02 ]
KYLIN-5730 Add more helpful message
> Query dry-run for better modeling
> -
>
> Key: KYLIN-5730
> URL: https://issues.apache.org/jira/browse/KYLIN-5730
> Project: Kylin
> Issue Type: Improvement
>Affects Versions: 5.0-beta
>Reporter: Xiaoxiang Yu
>Assignee: Xiaoxiang Yu
>Priority: Major
> Fix For: 5.0.0
>
> Attachments: KYLIN-5730-01.png, KYLIN-5730-02.png, KYLIN-5730-03.png
>
>
> h2. Background
> When user enable this feature, the query insight page will display helpful
> message
> for user to understand why model is not match and what to do in next step.
>
> Following messages will display some query analytics, including at least:
> # RelNode Tree
> # OLAPContext and matched Model for each context
> # Spark Physical Plan
> Configuration entry is 'kylin.query.dryrun-enabled', at project level.
> h2. How to use
> # enable this in project configuration
> # send a query in Insight page
> # read Dry-run message and fix something and retry
>
> h4. Dry-run message sample:
> # {{Last Exception :}}
> {{{} No realization found for {id = 0, model = not matched, fact table =
> TPCH_CN.LINEITEM{
> {{ Incapable message : MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN,
> MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN,
> MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN, MODEL_UNMATCHED_JOIN, }}
> # {{OLAPContext(s) and matched model(s) :}}
> {{ Ctx=0 is not matched by any model/snapshot, recommend :}}
> {{ {}}
> {{ "Fact Table" : "TPCH_CN.LINEITEM",}}
> {{ "Dimension Tables" : [ "TPCH_CN.REGION", "TPCH_CN.ORDERS",
> "TPCH_CN.SUPPLIER", "TPCH_CN.PART", "TPCH_CN.CUSTOMER", "TPCH_CN.NATION"],}}
> {{ "Query Columns" : [ "TPCH_CN.NATION.N_NAME",
> "TPCH_CN.ORDERS.O_ORDERDATE", "TPCH_CN.REGION.R_NAME", "TPCH_CN.PART.P_TYPE",
> "TPCH_CN.LINEITEM.DISC_PRICE"],}}
> {{ "Dimension(Group by)" : [ "TPCH_CN.ORDERS.O_ORDERDATE"],}}
> {{ "Dimension(Filter cond)" : [ "TPCH_CN.ORDERS.O_ORDERDATE",
> "TPCH_CN.REGION.R_NAME", "TPCH_CN.PART.P_TYPE"],}}
> {{ "Measure" : [ "SUM(UNKNOWN_ALIAS.$F1)",
> "SUM(T_1_4CD6601C.DISC_PRICE)"],}}
> {{ "Join" : "}}
> {{Fact: [T_1_4CD6601C:LINEITEM]}}
> {{ Dim: [T_1_4CD6601C:LINEITEM] INNER JOIN [T_2_716C1DB8:PART] ON
> [L_PARTKEY] = [P_PARTKEY]}}
> {{ Dim: [T_1_4CD6601C:LINEITEM] INNER JOIN [T_3_6D21031C:SUPPLIER] ON
> [L_SUPPKEY] = [S_SUPPKEY]}}
> {{ Dim: [T_3_6D21031C:SUPPLIER] INNER JOIN [T_7_4F00CD31:NATION] ON
> [S_NATIONKEY] = [N_NATIONKEY]}}
> {{ Dim: [T_1_4CD6601C:LINEITEM] INNER JOIN [T_4_5CEAD9DF:ORDERS] ON
> [L_ORDERKEY] = [O_ORDERKEY]}}
> {{ Dim: [T_4_5CEAD9DF:ORDERS] INNER JOIN [T_5_54B979E7:CUSTOMER] ON
> [O_CUSTKEY] = [C_CUSTKEY]}}
> {{ Dim: [T_5_54B979E7:CUSTOMER] INNER JOIN [T_6_42081A08:NATION] ON
> [C_NATIONKEY] = [N_NATIONKEY]}}
> {{ Dim: [T_6_42081A08:NATION] INNER JOIN [T_8_B14C00A:REGION] ON
> [N_REGIONKEY] = [R_REGIONKEY]",}}
> {{ "Index Id" : 0,}}
> {{ "Query Column / Index Column" : "5 / 0",}}
> {{ "Index Columns" : []}}
> {{{} }{{
> # {{RelNode(with ctx id) :}}
> {{ OLAPToEnumerableConverter}}
> {{ LimitRel(ctx=[0@null], fetch=[500])}}
> {{ SortRel(sort0=[$0], dir0=[ASC-nulls-first], ctx=[0@null])}}
> {{ ProjectRel(O_YEAR=[$0], MKT_SHARE=[/($1, $2)], ctx=[0@null])}}
> {{ AggregateRel(group-set=[[0]], groups=[null], agg#0=[SUM($1)],
> agg#1=[SUM($2)], ctx=[0@null])}}
> {{ ProjectRel(O_YEAR=[EXTRACT(FLAG(YEAR), $54)], $f1=[CASE(=($72,
> 'BRAZIL'), $16, 0)], VOLUME=[$16], ctx=[0@null])}}
> {{ FilterRel(condition=[AND(=($76, 'AMERICA'), >=($54,
> 1995-01-01), <=($54, 1996-12-31), =($38, 'ECONOMY ANODIZED STEEL'))],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($69, $75)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($46, $71)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($62, $67)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($51, $59)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($0, $50)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($2, $43)], joinType=[inner],
> ctx=[0@null])}}
> {{ JoinRel(condition=[=($1, $34)], joinType=[inner],
> ctx=[0@null])}}
> {{ TableScan(table=[[TPCH_CN, LINEITEM]],
> ctx=[0@null],
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793484#comment-17793484 ] ASF subversion and git services commented on KYLIN-5730: Commit d7c58474ae334ec98a884295328b423b554fd750 in kylin's branch refs/heads/kylin5 from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d7c58474ae ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793230#comment-17793230 ] ASF subversion and git services commented on KYLIN-5730: Commit 23393b5ca53516fd2c134f52161c531962b15e32 in kylin's branch refs/heads/kylin5-docker-debug from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=23393b5ca5 ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793202#comment-17793202 ] ASF subversion and git services commented on KYLIN-5730: Commit 7ca4b1a06faa78e1ae530a07254391e23e624997 in kylin's branch refs/heads/kylin5-docker-debug from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=7ca4b1a06f ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793176#comment-17793176 ] ASF subversion and git services commented on KYLIN-5730: Commit 5894eb4fa065d3f36966d8510b8d01c06817b0e2 in kylin's branch refs/heads/kylin5-docker-debug from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=5894eb4fa0 ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793160#comment-17793160 ] ASF subversion and git services commented on KYLIN-5730: Commit 737563b7a06bcdba6138e61ea99f7c9c00a1b056 in kylin's branch refs/heads/kylin5-docker-debug from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=737563b7a0 ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793155#comment-17793155 ] ASF subversion and git services commented on KYLIN-5730: Commit 6a7ffc283f05287dfc7d1dffaf28f35080f3b433 in kylin's branch refs/heads/kylin5-docker-debug from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6a7ffc283f ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793152#comment-17793152 ] ASF subversion and git services commented on KYLIN-5730: Commit 6a0781f3ad0aa59a12d839bd053df6ddf2d90d8a in kylin's branch refs/heads/kylin5-docker-debug from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6a0781f3ad ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5730) Query dry-run for better modeling
[ https://issues.apache.org/jira/browse/KYLIN-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793121#comment-17793121 ] ASF subversion and git services commented on KYLIN-5730: Commit 53145b53bc0232752efde06dcc219cc18f984995 in kylin's branch refs/heads/kylin5-docker-debug from Xiaoxiang Yu [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=53145b53bc ] KYLIN-5730 Query dry-run for better modeling > Query dry-run for better modeling > - > > Key: KYLIN-5730 > URL: https://issues.apache.org/jira/browse/KYLIN-5730 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Xiaoxiang Yu >Assignee: Xiaoxiang Yu >Priority: Major > Fix For: 5.0.0 > > > When user enable this feature, the query insight page will display helpful > message for user to understand why model is not match. > > Following messages will display some query analytics, including at least: > # RelNode Tree > # OLAPContext and matched Model for each context > # Spark Physical Plan > Configuration entry is 'kylin.query.dryrun-enabled', at project level. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5729) Supports email notification when jobs are finished or discarded
[ https://issues.apache.org/jira/browse/KYLIN-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791936#comment-17791936 ] ASF subversion and git services commented on KYLIN-5729: Commit 51a41aa0849dd28428e7862220680fb1d9710748 in kylin's branch refs/heads/kylin5 from Qian Xia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=51a41aa084 ] KYLIN-5729 Supports email notification when jobs are finished or discarded > Supports email notification when jobs are finished or discarded > --- > > Key: KYLIN-5729 > URL: https://issues.apache.org/jira/browse/KYLIN-5729 > Project: Kylin > Issue Type: Bug >Reporter: Laura Xia >Assignee: Laura Xia >Priority: Major > Fix For: 5.0.0 > > Attachments: image-2023-12-01-15-43-47-377.png > > > !image-2023-12-01-15-43-47-377.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5725) After turning on the email alert configuration, the operation task prompts an unknown error, and the query underpressing also reports an error.
[ https://issues.apache.org/jira/browse/KYLIN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788287#comment-17788287 ] ASF subversion and git services commented on KYLIN-5725: Commit 6f5030377d588d0180e5e050e65e2827ed9b7a03 in kylin's branch refs/heads/kylin5 from sibingzhang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=6f5030377d ] KYLIN-5725 fix open the email notification configuration, to operate job and query failed Co-authored-by: sibing.zhang > After turning on the email alert configuration, the operation task prompts an > unknown error, and the query underpressing also reports an error. > --- > > Key: KYLIN-5725 > URL: https://issues.apache.org/jira/browse/KYLIN-5725 > Project: Kylin > Issue Type: Bug >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: sibing.zhang >Priority: Critical > Fix For: 5.0.0 > > Attachments: image-2023-11-17-15-03-23-989.png, > image-2023-11-17-15-05-29-264.png > > > Steps to Reproduce > 1:Configure to enable email alerts > 2:Create a model and initiate a build task. > 3:In the task list operation task restart, pause, terminate > 4:Query sql, expect query downpressure > Actual result > 3:Operation error report > 4:Query error -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5724) Support local debug & glue hive client cache
[ https://issues.apache.org/jira/browse/KYLIN-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788286#comment-17788286 ] ASF subversion and git services commented on KYLIN-5724: Commit 053a3293f3478d7157ae06c86ba72ce04bcd5e95 in kylin's branch refs/heads/kylin5 from yihuawu1986 [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=053a3293f3 ] KYLIN-5724 Support local debug & glue hive client cache > Support local debug & glue hive client cache > > > Key: KYLIN-5724 > URL: https://issues.apache.org/jira/browse/KYLIN-5724 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Hongrong Cao >Priority: Minor > Fix For: 5.0.0 > > > Need to update hadoop-aws-3.3.1.jar and > aws-glue-datacatalog-spark-client-3.4.0-SNAPSHOT.jar to spark jars -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5721) The input parameters of some date functions support string format
[ https://issues.apache.org/jira/browse/KYLIN-5721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788290#comment-17788290 ] ASF subversion and git services commented on KYLIN-5721: Commit 67ea6928e8b9c5cd23b9e76d1c0fe41f3fd00864 in kylin's branch refs/heads/kylin5 from liang.huang [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=67ea6928e8 ] KYLIN-5721 [FOLLOW UP] fix calcite jar no to support timestampadd/diff's date string args > The input parameters of some date functions support string format > - > > Key: KYLIN-5721 > URL: https://issues.apache.org/jira/browse/KYLIN-5721 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Hongrong Cao >Priority: Critical > Fix For: 5.0.0 > > > date_trunc > date_trunc > minute > date_trunc > extract > These functions hopefully also implement date strings as arguments. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5722) Optimize KylinConfExt
[ https://issues.apache.org/jira/browse/KYLIN-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788284#comment-17788284 ] ASF subversion and git services commented on KYLIN-5722: Commit 75ce83ad6693a94c140917c83059d375e381f598 in kylin's branch refs/heads/kylin5 from Mingming Ge [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=75ce83ad66 ] KYLIN-5722 Optimize KylinConfigExt > Optimize KylinConfExt > - > > Key: KYLIN-5722 > URL: https://issues.apache.org/jira/browse/KYLIN-5722 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Hongrong Cao >Priority: Critical > Fix For: 5.0.0 > > > KylinConfigExt every time create a new instance to get the configuration, > you will get it through the > org.apache.kylin.common.KylinConfigExt#getSubstitutor method, which will new > a HashMap every time and then do the element copy action, the method is time > consuming and needs to be optimized. This method is time-consuming and needs > to be optimized. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (KYLIN-5719) Occasional initialization failure of the V3 global dictionary file, resulting in failure of build jobs
[ https://issues.apache.org/jira/browse/KYLIN-5719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17788283#comment-17788283 ] ASF subversion and git services commented on KYLIN-5719: Commit bc00ef2ab5ccfc85542c31e375f222bd32a0e0b5 in kylin's branch refs/heads/kylin5 from Yaguang Jia [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=bc00ef2ab5 ] KYLIN-5719 [FOLLOW UP] v3dct catch DeltaConcurrentModificationException > Occasional initialization failure of the V3 global dictionary file, resulting > in failure of build jobs > -- > > Key: KYLIN-5719 > URL: https://issues.apache.org/jira/browse/KYLIN-5719 > Project: Kylin > Issue Type: Improvement >Affects Versions: 5.0-beta >Reporter: Hongrong Cao >Assignee: Yaguang Jia >Priority: Major > Fix For: 5.0.0 > > > As in the title. > Hopefully the occasional failure to initialize the dictionary file won't > affect the build task -- This message was sent by Atlassian Jira (v8.20.10#820010)
