[jira] [Updated] (KYLIN-5187) Support Alluxio Local Cache + Soft Affinity to speed up the query performance on the cloud

2022-05-24 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-5187: -- Description: Support Alluxio Local Cache + Soft Affinity to speed up the query performance on

[jira] [Created] (KYLIN-5187) Support Alluxio Local Cache + Soft Affinity to speed up the query performance on the cloud

2022-05-24 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-5187: - Summary: Support Alluxio Local Cache + Soft Affinity to speed up the query performance on the cloud Key: KYLIN-5187 URL: https://issues.apache.org/jira/browse/KYLIN-5187

[jira] [Commented] (KYLIN-5057) CubeBuildJob in Kylin4.0 run failed when open Spark3.1 AQE

2021-08-09 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395861#comment-17395861 ] Zhichao Zhang commented on KYLIN-5057: --- Thank [~tianhui5], I reproduce this issue, and will check

[jira] [Updated] (KYLIN-5058) Throws ConcurrentModificationException when building cube

2021-08-09 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-5058: -- Description: When building cubes, there is an error 'ConcurrentModificationException' thrown

[jira] [Created] (KYLIN-5058) Throws ConcurrentModificationException when building cube

2021-08-09 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-5058: - Summary: Throws ConcurrentModificationException when building cube Key: KYLIN-5058 URL: https://issues.apache.org/jira/browse/KYLIN-5058 Project: Kylin

[jira] [Commented] (KYLIN-5057) CubeBuildJob in Kylin4.0 run failed when open Spark3.1 AQE

2021-08-08 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395486#comment-17395486 ] Zhichao Zhang commented on KYLIN-5057: --- [~tianhui5], I can't reproduce this error on my docker

[jira] [Commented] (KYLIN-5057) CubeBuildJob in Kylin4.0 run failed when open Spark3.1 AQE

2021-08-06 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17394700#comment-17394700 ] Zhichao Zhang commented on KYLIN-5057: --- Thank [~tianhui5], I will check this issue. >

[jira] [Reopened] (KYLIN-4762) Optimize join where there is the same shardby partition num on join key

2021-08-03 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reopened KYLIN-4762: --- This issue isn't resolved yet. > Optimize join where there is the same shardby partition num on

[jira] [Updated] (KYLIN-4762) Optimize join where there is the same shardby partition num on join key

2021-08-03 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4762: -- Fix Version/s: (was: v4.0.0) v4.1.0 > Optimize join where there is the

[jira] [Resolved] (KYLIN-5014) Spark driver log is abnormal in yarn cluster mode

2021-06-24 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-5014. --- Resolution: Fixed > Spark driver log is abnormal in yarn cluster mode >

[jira] [Assigned] (KYLIN-5008) backend spark was failed, but corresponding job status is shown as finished in WebUI

2021-06-11 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-5008: - Assignee: Yaqian Zhang (was: Zhichao Zhang) > backend spark was failed, but

[jira] [Assigned] (KYLIN-5008) backend spark was failed, but corresponding job status is shown as finished in WebUI

2021-06-10 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-5008: - Assignee: Zhichao Zhang > backend spark was failed, but corresponding job status is

[jira] [Resolved] (KYLIN-4926) Optimize Global Dict building: replace operation 'mapPartitions.count()' with 'foreachPartitions'

2021-05-10 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4926. --- Resolution: Fixed > Optimize Global Dict building: replace operation 'mapPartitions.count()'

[jira] [Resolved] (KYLIN-4741) Support to config the sparder application name

2021-05-10 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4741. --- Fix Version/s: v4.0.0-beta Resolution: Fixed > Support to config the sparder

[jira] [Resolved] (KYLIN-4937) Verify the uniqueness of the global dictionary after building global dictionary

2021-05-10 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4937. --- Resolution: Fixed > Verify the uniqueness of the global dictionary after building global >

[jira] [Resolved] (KYLIN-4927) Forbid to use AE when building Global Dict

2021-05-10 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4927. --- Resolution: Fixed > Forbid to use AE when building Global Dict >

[jira] [Resolved] (KYLIN-4936) Exactly aggregation can't transform to project

2021-05-10 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4936. --- Resolution: Fixed > Exactly aggregation can't transform to project >

[jira] [Resolved] (KYLIN-4980) Support prunning segments from complex filter conditions

2021-04-25 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4980. --- Resolution: Fixed > Support prunning segments from complex filter conditions >

[jira] [Updated] (KYLIN-4967) Forbid to set 'spark.sql.adaptive.enabled' to true when building cube with Spark 2.X

2021-04-11 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4967: -- Affects Version/s: v4.0.0-beta > Forbid to set 'spark.sql.adaptive.enabled' to true when

[jira] [Updated] (KYLIN-4967) Forbid to set 'spark.sql.adaptive.enabled' to true when building cube with Spark 2.X

2021-04-11 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4967: -- Fix Version/s: v4.0.0-GA > Forbid to set 'spark.sql.adaptive.enabled' to true when building

[jira] [Updated] (KYLIN-4965) model中使用join表中的字段作为filter过滤条件,在cube构建时报错

2021-04-11 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4965: -- Fix Version/s: (was: Future) v4.0.0-GA >

[jira] [Created] (KYLIN-4967) Forbid to set 'spark.sql.adaptive.enabled' to true when building cube with Spark 2.X

2021-04-11 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4967: - Summary: Forbid to set 'spark.sql.adaptive.enabled' to true when building cube with Spark 2.X Key: KYLIN-4967 URL: https://issues.apache.org/jira/browse/KYLIN-4967

[jira] [Assigned] (KYLIN-4965) model中使用join表中的字段作为filter过滤条件,在cube构建时报错

2021-04-11 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-4965: - Assignee: Zhichao Zhang > model中使用join表中的字段作为filter过滤条件,在cube构建时报错 >

[jira] [Commented] (KYLIN-4965) model中使用join表中的字段作为filter过滤条件,在cube构建时报错

2021-04-08 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317611#comment-17317611 ] Zhichao Zhang commented on KYLIN-4965: --- I will check this issue and fix it if there is problem. >

[jira] [Created] (KYLIN-4944) Upgrade CentOS version, Hadoop version and Spark version for Kylin Docker image

2021-03-23 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4944: - Summary: Upgrade CentOS version, Hadoop version and Spark version for Kylin Docker image Key: KYLIN-4944 URL: https://issues.apache.org/jira/browse/KYLIN-4944

[jira] [Resolved] (KYLIN-4913) Update docker image for Kylin 4.0 Beta

2021-03-20 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4913. --- Resolution: Fixed > Update docker image for Kylin 4.0 Beta >

[jira] [Created] (KYLIN-4937) Verify the uniqueness of the global dictionary after building global dictionary

2021-03-18 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4937: - Summary: Verify the uniqueness of the global dictionary after building global dictionary Key: KYLIN-4937 URL: https://issues.apache.org/jira/browse/KYLIN-4937

[jira] [Assigned] (KYLIN-4936) Exactly aggregation can't transform to project

2021-03-18 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-4936: - Assignee: Zhichao Zhang > Exactly aggregation can't transform to project >

[jira] [Created] (KYLIN-4927) Forbid to use AE when building Global Dict

2021-03-04 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4927: - Summary: Forbid to use AE when building Global Dict Key: KYLIN-4927 URL: https://issues.apache.org/jira/browse/KYLIN-4927 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-4926) Optimize Global Dict building: replace operation 'mapPartitions.count()' with 'foreachPartitions'

2021-03-04 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4926: -- Summary: Optimize Global Dict building: replace operation 'mapPartitions.count()' with

[jira] [Created] (KYLIN-4926) Optimize Global Dict build: replace operation 'mapPartitions.count()' with 'foreachPartitions'

2021-03-04 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4926: - Summary: Optimize Global Dict build: replace operation 'mapPartitions.count()' with 'foreachPartitions' Key: KYLIN-4926 URL: https://issues.apache.org/jira/browse/KYLIN-4926

[jira] [Closed] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-25 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang closed KYLIN-4916. - > ShardingReadRDD's partition number was set to shardNum,causing empty spark > tasks >

[jira] [Resolved] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-25 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4916. --- Fix Version/s: v4.0.0-beta Resolution: Won't Fix > ShardingReadRDD's partition number

[jira] [Commented] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-24 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290638#comment-17290638 ] Zhichao Zhang commented on KYLIN-4916: --- This is expected behavior, similar to spark bucket

[jira] [Comment Edited] (KYLIN-4914) Failed to query "select * from {fact_table}" if a fact table used in two different cubes

2021-02-23 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289715#comment-17289715 ] Zhichao Zhang edited comment on KYLIN-4914 at 2/24/21, 7:02 AM: - 'select

[jira] [Commented] (KYLIN-4914) Failed to query "select * from {fact_table}" if a fact table used in two different cubes

2021-02-23 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289715#comment-17289715 ] Zhichao Zhang commented on KYLIN-4914: --- 'select * from \{fact_table}' is querying detailed data

[jira] [Created] (KYLIN-4913) Update docker image for Kylin 4.0 Beta

2021-02-23 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4913: - Summary: Update docker image for Kylin 4.0 Beta Key: KYLIN-4913 URL: https://issues.apache.org/jira/browse/KYLIN-4913 Project: Kylin Issue Type:

[jira] [Assigned] (KYLIN-4910) Sparder URL is hardcoded to localhost

2021-02-22 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-4910: - Assignee: ShengJun Zheng > Sparder URL is hardcoded to localhost >

[jira] [Assigned] (KYLIN-4908) Segment pruner support integer partition col in spark query engine

2021-02-22 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-4908: - Assignee: ShengJun Zheng > Segment pruner support integer partition col in spark query

[jira] [Commented] (KYLIN-4905) Support limit .. offset ... in spark query engine

2021-02-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286269#comment-17286269 ] Zhichao Zhang commented on KYLIN-4905: --- Thank [~zhengshengjun], please raise a pr. > Support

[jira] [Commented] (KYLIN-4904) build cubes error

2021-02-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286256#comment-17286256 ] Zhichao Zhang commented on KYLIN-4904: --- [~stayblank] , the version of spark is not the apache

[jira] [Commented] (KYLIN-4904) build cubes error

2021-02-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285708#comment-17285708 ] Zhichao Zhang commented on KYLIN-4904: --- [~stayblank], can you show the properties you configured,

[jira] [Resolved] (KYLIN-4846) Set the related query id to sparder job description

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4846. --- Fix Version/s: v4.0.0-beta Resolution: Fixed > Set the related query id to sparder

[jira] [Resolved] (KYLIN-4797) Correct inputRecordSizes of segment when there is no data in this segment

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4797. --- Fix Version/s: v4.0.0-alpha Resolution: Fixed > Correct inputRecordSizes of segment

[jira] [Resolved] (KYLIN-4730) Add scan bytes metric to the query results

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4730. --- Fix Version/s: v2.6.6 v4.0.0-alpha Resolution: Fixed > Add scan

[jira] [Updated] (KYLIN-4730) Add scan bytes metric to the query results

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4730: -- Fix Version/s: (was: v2.6.6) > Add scan bytes metric to the query results >

[jira] [Resolved] (KYLIN-4452) Kylin on Parquet with Docker

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4452. --- Resolution: Fixed > Kylin on Parquet with Docker > > >

[jira] [Resolved] (KYLIN-4894) Upgrade Apache Spark version to 2.4.7

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4894. --- Fix Version/s: v4.0.0-GA Resolution: Fixed > Upgrade Apache Spark version to 2.4.7 >

[jira] [Resolved] (KYLIN-4893) Optimize query performance when using shard by column

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4893. --- Fix Version/s: v4.0.0-GA Resolution: Fixed > Optimize query performance when using

[jira] [Resolved] (KYLIN-4892) Reduce the times of fetching files status from HDFS in FilePruner

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4892. --- Resolution: Fixed > Reduce the times of fetching files status from HDFS in FilePruner >

[jira] [Resolved] (KYLIN-4890) Use numSlices = 1 to reduce task num when executing sparder canary

2021-02-07 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4890. --- Resolution: Fixed > Use numSlices = 1 to reduce task num when executing sparder canary >

[jira] [Created] (KYLIN-4894) Upgrade Apache Spark version to 2.4.7

2021-02-02 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4894: - Summary: Upgrade Apache Spark version to 2.4.7 Key: KYLIN-4894 URL: https://issues.apache.org/jira/browse/KYLIN-4894 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-4893) Optimize query performance when using shard by column

2021-02-02 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4893: -- Description: Optimize query performance when using shard by column. > Optimize query

[jira] [Created] (KYLIN-4893) Optimize query performance when using shard by column

2021-02-02 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4893: - Summary: Optimize query performance when using shard by column Key: KYLIN-4893 URL: https://issues.apache.org/jira/browse/KYLIN-4893 Project: Kylin Issue

[jira] [Resolved] (KYLIN-4891) Set the default value of 'kylin.query.spark-engine.expose-sharding-trait' to false

2021-02-02 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4891. --- Resolution: Won't Fix Don't fix, use other way to optimize > Set the default value of

[jira] [Updated] (KYLIN-4889) Query error when spark engine in local mode

2021-01-29 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4889: -- Fix Version/s: (was: v4.0.0-beta) > Query error when spark engine in local mode >

[jira] [Updated] (KYLIN-4889) Query error when spark engine in local mode

2021-01-29 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4889: -- Fix Version/s: v4.0.0-GA > Query error when spark engine in local mode >

[jira] [Created] (KYLIN-4892) Reduce the times of fetching files status from HDFS in FilePruner

2021-01-28 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4892: - Summary: Reduce the times of fetching files status from HDFS in FilePruner Key: KYLIN-4892 URL: https://issues.apache.org/jira/browse/KYLIN-4892 Project: Kylin

[jira] [Created] (KYLIN-4891) Set the default value of 'kylin.query.spark-engine.expose-sharding-trait' to false

2021-01-28 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4891: - Summary: Set the default value of 'kylin.query.spark-engine.expose-sharding-trait' to false Key: KYLIN-4891 URL: https://issues.apache.org/jira/browse/KYLIN-4891

[jira] [Created] (KYLIN-4890) Use numSlices = 1 to reduce task num when executing sparder canary

2021-01-28 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4890: - Summary: Use numSlices = 1 to reduce task num when executing sparder canary Key: KYLIN-4890 URL: https://issues.apache.org/jira/browse/KYLIN-4890 Project: Kylin

[jira] [Created] (KYLIN-4877) Use all dimension columns as sort columns when saving cuboid data

2021-01-18 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4877: - Summary: Use all dimension columns as sort columns when saving cuboid data Key: KYLIN-4877 URL: https://issues.apache.org/jira/browse/KYLIN-4877 Project: Kylin

[jira] [Created] (KYLIN-4875) Remove executor configurations when execute resource detect step (local mode)

2021-01-17 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4875: - Summary: Remove executor configurations when execute resource detect step (local mode) Key: KYLIN-4875 URL: https://issues.apache.org/jira/browse/KYLIN-4875

[jira] [Resolved] (KYLIN-4872) Fix NPE when there are more than one segment if cube planner is open

2021-01-14 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4872. --- Resolution: Fixed > Fix NPE when there are more than one segment if cube planner is open >

[jira] [Created] (KYLIN-4872) Fix NPE when there are more than one segment if cube planner is open

2021-01-13 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4872: - Summary: Fix NPE when there are more than one segment if cube planner is open Key: KYLIN-4872 URL: https://issues.apache.org/jira/browse/KYLIN-4872 Project: Kylin

[jira] [Commented] (KYLIN-4864) Support building and testing Kylin on ARM64 architecture platform

2021-01-10 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17262346#comment-17262346 ] Zhichao Zhang commented on KYLIN-4864: --- [~seanlau],sounds good, have you already made Kylin

[jira] [Created] (KYLIN-4849) Support sum(case when...), sum(2*price+1), count(column) and more for Kylin 4

2020-12-28 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4849: - Summary: Support sum(case when...), sum(2*price+1), count(column) and more for Kylin 4 Key: KYLIN-4849 URL: https://issues.apache.org/jira/browse/KYLIN-4849

[jira] [Created] (KYLIN-4846) Set the related query id to sparder job description

2020-12-20 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4846: - Summary: Set the related query id to sparder job description Key: KYLIN-4846 URL: https://issues.apache.org/jira/browse/KYLIN-4846 Project: Kylin Issue

[jira] [Resolved] (KYLIN-4828) Add more sql test cases into NBuildAndQueryTest

2020-12-18 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4828. --- Resolution: Fixed > Add more sql test cases into NBuildAndQueryTest >

[jira] [Reopened] (KYLIN-4828) Add more sql test cases into NBuildAndQueryTest

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reopened KYLIN-4828: --- There are some un-supported sqls left. > Add more sql test cases into NBuildAndQueryTest >

[jira] [Resolved] (KYLIN-4844) Add lookup table duplicate key check when building job

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4844. --- Resolution: Fixed Please see : [https://github.com/apache/kylin/pull/1514]  > Add lookup

[jira] [Resolved] (KYLIN-4817) Refine Cube Migration Tool for Kylin4

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4817. --- Resolution: Fixed > Refine Cube Migration Tool for Kylin4 >

[jira] [Resolved] (KYLIN-4813) Refine spark logger for Kylin 4 build engine

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4813. --- Resolution: Fixed > Refine spark logger for Kylin 4 build engine >

[jira] [Resolved] (KYLIN-4820) Can not auto set spark resources configurations when building cube

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4820. --- Resolution: Fixed > Can not auto set spark resources configurations when building cube >

[jira] [Resolved] (KYLIN-4822) The metrics 'Total spark scan time' of query log is negative in some cases

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4822. --- Resolution: Fixed > The metrics 'Total spark scan time' of query log is negative in some

[jira] [Resolved] (KYLIN-4824) The metric 'Total scan bytes' of 'Query Log' is always 0 when querying

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4824. --- Resolution: Fixed > The metric 'Total scan bytes' of 'Query Log' is always 0 when querying >

[jira] [Resolved] (KYLIN-4829) Support to use thread-level SparkSession to execute query

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4829. --- Resolution: Fixed > Support to use thread-level SparkSession to execute query >

[jira] [Resolved] (KYLIN-4843) Support INTERSECT_COUNT/INTERSECT_VALUE function for Kylin 4

2020-12-17 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4843. --- Resolution: Fixed > Support INTERSECT_COUNT/INTERSECT_VALUE function for Kylin 4 >

[jira] [Updated] (KYLIN-4843) Support INTERSECT_COUNT/INTERSECT_VALUE function for Kylin 4

2020-12-15 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4843: -- Description: Support INTERSECT_COUNT/INTERSECT_VALUE function for Kylin 4 (was: Support

[jira] [Updated] (KYLIN-4843) Support INTERSECT_COUNT/INTERSECT_VALUE function for Kylin 4

2020-12-15 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4843: -- Summary: Support INTERSECT_COUNT/INTERSECT_VALUE function for Kylin 4 (was: Support

[jira] [Created] (KYLIN-4843) Support INTERSECT_VALUE function for Kylin 4

2020-12-15 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4843: - Summary: Support INTERSECT_VALUE function for Kylin 4 Key: KYLIN-4843 URL: https://issues.apache.org/jira/browse/KYLIN-4843 Project: Kylin Issue Type: New

[jira] [Created] (KYLIN-4842) Supports grouping sets function for Kylin 4

2020-12-14 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4842: - Summary: Supports grouping sets function for Kylin 4 Key: KYLIN-4842 URL: https://issues.apache.org/jira/browse/KYLIN-4842 Project: Kylin Issue Type: New

[jira] [Updated] (KYLIN-4840) When pushdown is enabled, execute sql which includes subquery will be pushdowned

2020-12-11 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4840: -- Description: When pushdown is enabled, execute sql which includes subquery will be

[jira] [Created] (KYLIN-4841) Spark RDD cache is invalid when building with spark engine

2020-12-11 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4841: - Summary: Spark RDD cache is invalid when building with spark engine Key: KYLIN-4841 URL: https://issues.apache.org/jira/browse/KYLIN-4841 Project: Kylin

[jira] [Created] (KYLIN-4840) When pushdown is enabled, execute sql which includes subquery will be pushdowned

2020-12-11 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4840: - Summary: When pushdown is enabled, execute sql which includes subquery will be pushdowned Key: KYLIN-4840 URL: https://issues.apache.org/jira/browse/KYLIN-4840

[jira] [Resolved] (KYLIN-4828) Add more sql test cases into NBuildAndQueryTest

2020-12-06 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4828. --- Resolution: Fixed Done > Add more sql test cases into NBuildAndQueryTest >

[jira] [Created] (KYLIN-4829) Support to use thread-level SparkSession to execute query

2020-11-29 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4829: - Summary: Support to use thread-level SparkSession to execute query Key: KYLIN-4829 URL: https://issues.apache.org/jira/browse/KYLIN-4829 Project: Kylin

[jira] [Created] (KYLIN-4828) Add more sql test cases into NBuildAndQueryTest

2020-11-26 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4828: - Summary: Add more sql test cases into NBuildAndQueryTest Key: KYLIN-4828 URL: https://issues.apache.org/jira/browse/KYLIN-4828 Project: Kylin Issue Type:

[jira] [Created] (KYLIN-4824) The metric 'Total scan bytes' of 'Query Log' is always 0 when querying

2020-11-22 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4824: - Summary: The metric 'Total scan bytes' of 'Query Log' is always 0 when querying Key: KYLIN-4824 URL: https://issues.apache.org/jira/browse/KYLIN-4824 Project:

[jira] [Resolved] (KYLIN-4738) The order in the returned result is wrong when use window function to query in kylin

2020-11-20 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4738. --- Fix Version/s: v4.0.0-beta Resolution: Won't Fix Don't need to fix. > The order in

[jira] [Created] (KYLIN-4822) The metrics 'Total spark scan time' of query log is negative in some cases

2020-11-17 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4822: - Summary: The metrics 'Total spark scan time' of query log is negative in some cases Key: KYLIN-4822 URL: https://issues.apache.org/jira/browse/KYLIN-4822 Project:

[jira] [Created] (KYLIN-4820) Can not auto set spark resources configurations when building cube

2020-11-15 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4820: - Summary: Can not auto set spark resources configurations when building cube Key: KYLIN-4820 URL: https://issues.apache.org/jira/browse/KYLIN-4820 Project: Kylin

[jira] [Commented] (KYLIN-4812) Create Dimension Dictionary With Spark Failed

2020-11-13 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17231576#comment-17231576 ] Zhichao Zhang commented on KYLIN-4812: --- The spark which kylin used doesn't support to connect Hive

[jira] [Resolved] (KYLIN-4737) The precision in the returned result is different from the one by Spark SQL

2020-11-12 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4737. --- Fix Version/s: v4.0.0-beta Resolution: Won't Fix The root cause of this issue is that

[jira] [Commented] (KYLIN-4812) Create Dimension Dictionary With Spark Failed

2020-11-11 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17230397#comment-17230397 ] Zhichao Zhang commented on KYLIN-4812: --- [~vincentzeng] which versions of hadoop and hive you used?

[jira] [Resolved] (KYLIN-4811) Support cube level configuration for BuildingJob

2020-11-08 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang resolved KYLIN-4811. --- Resolution: Fixed Done > Support cube level configuration for BuildingJob >

[jira] [Assigned] (KYLIN-4811) Support cube level configuration for BuildingJob

2020-11-08 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang reassigned KYLIN-4811: - Assignee: Xiaoxiang Yu > Support cube level configuration for BuildingJob >

[jira] [Commented] (KYLIN-4762) Optimize join where there is the same shardby partition num on join key

2020-10-28 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222000#comment-17222000 ] Zhichao Zhang commented on KYLIN-4762: --- The [PR1463|https://github.com/apache/kylin/pull/1463]

[jira] [Created] (KYLIN-4797) Correct inputRecordSizes of segment when there is no data in this segment

2020-10-22 Thread Zhichao Zhang (Jira)
Zhichao Zhang created KYLIN-4797: - Summary: Correct inputRecordSizes of segment when there is no data in this segment Key: KYLIN-4797 URL: https://issues.apache.org/jira/browse/KYLIN-4797 Project:

[jira] [Commented] (KYLIN-4776) Release Kylin v3.1.1

2020-10-19 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217273#comment-17217273 ] Zhichao Zhang commented on KYLIN-4776: --- ||Issue ID||Verified?||Documentation updated?||Others||

[jira] [Updated] (KYLIN-4791) Throws exception 'UnsupportedOperationException: empty.reduceLeft' when there are cast expressions in the filters of FilePruner

2020-10-19 Thread Zhichao Zhang (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhichao Zhang updated KYLIN-4791: -- Description: When execute function 'pruneSegments' of FilePruner, if there are some cast

  1   2   3   >