[jira] [Updated] (KYLIN-4810) TrieDictionary is not correctly build

2020-11-07 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4810: -- Flags: (was: Patch) > TrieDictionary is not correctly build >

[jira] [Updated] (KYLIN-4810) TrieDictionary is not correctly build

2020-11-07 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4810: -- Description: Hi, recently, I've met a problem in our product environment: Segments failed to

[jira] [Updated] (KYLIN-4810) TrieDictionary is not correctly build

2020-11-07 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4810: -- Description: Hi, recently, I've met a problem in our product environment: Segments failed to

[jira] [Created] (KYLIN-4810) TrieDictionary is not correctly build

2020-11-07 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4810: - Summary: TrieDictionary is not correctly build Key: KYLIN-4810 URL: https://issues.apache.org/jira/browse/KYLIN-4810 Project: Kylin Issue Type: Bug

[jira] [Updated] (KYLIN-4810) TrieDictionary is not correctly build

2020-11-07 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4810: -- Description: Hi, recently, I've met a problem in our product environment: Segments failed to

[jira] [Created] (KYLIN-4850) Cube's override kylin_properties were ignored in building jobs

2020-12-28 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4850: - Summary: Cube's override kylin_properties were ignored in building jobs Key: KYLIN-4850 URL: https://issues.apache.org/jira/browse/KYLIN-4850 Project: Kylin

[jira] [Created] (KYLIN-4853) QueryPreparedStatementCache invalid in Spark Query Engine

2020-12-31 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4853: - Summary: QueryPreparedStatementCache invalid in Spark Query Engine Key: KYLIN-4853 URL: https://issues.apache.org/jira/browse/KYLIN-4853 Project: Kylin

[jira] [Commented] (KYLIN-4853) QueryPreparedStatementCache invalid in Spark Query Engine

2020-12-31 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256940#comment-17256940 ] ShengJun Zheng commented on KYLIN-4853: ---

[jira] [Issue Comment Deleted] (KYLIN-4853) QueryPreparedStatementCache invalid in Spark Query Engine

2020-12-31 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4853: -- Comment: was deleted (was:

[jira] [Created] (KYLIN-4859) Log4J reinitialized/reconfigured by Spark Logging

2021-01-04 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4859: - Summary: Log4J reinitialized/reconfigured by Spark Logging Key: KYLIN-4859 URL: https://issues.apache.org/jira/browse/KYLIN-4859 Project: Kylin Issue

[jira] [Created] (KYLIN-4887) Support partition pruner in spark query engine

2021-01-26 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4887: - Summary: Support partition pruner in spark query engine Key: KYLIN-4887 URL: https://issues.apache.org/jira/browse/KYLIN-4887 Project: Kylin Issue Type:

[jira] [Created] (KYLIN-5011) Detect and scatter skewed data in dict encoding step

2021-06-14 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-5011: - Summary: Detect and scatter skewed data in dict encoding step Key: KYLIN-5011 URL: https://issues.apache.org/jira/browse/KYLIN-5011 Project: Kylin Issue

[jira] [Created] (KYLIN-4998) Remove partition dimension to accelerate query

2021-05-26 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4998: - Summary: Remove partition dimension to accelerate query Key: KYLIN-4998 URL: https://issues.apache.org/jira/browse/KYLIN-4998 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-4998) Remove partition dimension in cuboid routing to accelerate query

2021-05-26 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4998: -- Summary: Remove partition dimension in cuboid routing to accelerate query (was: Remove

[jira] [Updated] (KYLIN-5019) Avoid building global dictionary from all data of fact table each time

2021-06-28 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-5019: -- Affects Version/s: v4.0.0-beta > Avoid building global dictionary from all data of fact table

[jira] [Created] (KYLIN-5019) Avoid building global dictionary from all data of fact table each time

2021-06-28 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-5019: - Summary: Avoid building global dictionary from all data of fact table each time Key: KYLIN-5019 URL: https://issues.apache.org/jira/browse/KYLIN-5019 Project:

[jira] [Updated] (KYLIN-4980) Support prunning segments from complex filter conditions

2021-04-22 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4980: -- Summary: Support prunning segments from complex filter conditions (was: Segment pruner can't

[jira] [Commented] (KYLIN-4989) Is there anyway to do data migtation from kylin 2.6.2 to the same version across different cluster?

2021-04-24 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17331357#comment-17331357 ] ShengJun Zheng commented on KYLIN-4989: --- Hi, '-kylinUriSrc ADMIN:KYLIN@srcHost:17070'  will fetch

[jira] [Created] (KYLIN-4906) support query/job server dynamic register and discovery

2021-02-07 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4906: - Summary: support query/job server dynamic register and discovery Key: KYLIN-4906 URL: https://issues.apache.org/jira/browse/KYLIN-4906 Project: Kylin

[jira] [Commented] (KYLIN-4906) support query/job server dynamic register and discovery

2021-02-07 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280809#comment-17280809 ] ShengJun Zheng commented on KYLIN-4906: --- thanks for [~zhangyaqian]'s time, the detailed answer is

[jira] [Updated] (KYLIN-4887) Support string type partition column in segment pruner in spark query engine

2021-01-27 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4887: -- Summary: Support string type partition column in segment pruner in spark query engine (was:

[jira] [Updated] (KYLIN-4887) Support partition pruner in spark query engine

2021-01-27 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4887: -- Description: when Partition col is String type, segment pruner will be invalid (was:

[jira] [Updated] (KYLIN-4887) Segment pruner support string type partition col in spark query engine

2021-01-27 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4887: -- Summary: Segment pruner support string type partition col in spark query engine (was: Support

[jira] [Updated] (KYLIN-4887) Support partition pruner in spark query engine

2021-01-27 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4887: -- Issue Type: Bug (was: Improvement) > Support partition pruner in spark query engine >

[jira] [Updated] (KYLIN-4887) Support string type partition col in segment pruner in spark query engine

2021-01-27 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4887: -- Summary: Support string type partition col in segment pruner in spark query engine (was:

[jira] [Created] (KYLIN-4945) Repartition encoded dataset to avoid data skew caused by a single column

2021-03-24 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4945: - Summary: Repartition encoded dataset to avoid data skew caused by a single column Key: KYLIN-4945 URL: https://issues.apache.org/jira/browse/KYLIN-4945 Project:

[jira] [Created] (KYLIN-4933) Support set cache strength for dict cache

2021-03-11 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4933: - Summary: Support set cache strength for dict cache Key: KYLIN-4933 URL: https://issues.apache.org/jira/browse/KYLIN-4933 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-4933) Support set cache strength for dict cache

2021-03-11 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4933: -- Affects Version/s: v3.1.1 > Support set cache strength for dict cache >

[jira] [Created] (KYLIN-4935) Existing JobOutput's extend info will be lost when it is updated

2021-03-16 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4935: - Summary: Existing JobOutput's extend info will be lost when it is updated Key: KYLIN-4935 URL: https://issues.apache.org/jira/browse/KYLIN-4935 Project: Kylin

[jira] [Created] (KYLIN-4941) Support encoding raw data to base cuboid column-by-column

2021-03-21 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4941: - Summary: Support encoding raw data to base cuboid column-by-column Key: KYLIN-4941 URL: https://issues.apache.org/jira/browse/KYLIN-4941 Project: Kylin

[jira] [Created] (KYLIN-4936) Exactly aggregation can't transform to project

2021-03-17 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4936: - Summary: Exactly aggregation can't transform to project Key: KYLIN-4936 URL: https://issues.apache.org/jira/browse/KYLIN-4936 Project: Kylin Issue Type:

[jira] [Updated] (KYLIN-4910) Return hostname as sparder url address when spark master is set to local

2021-02-28 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4910: -- Summary: Return hostname as sparder url address when spark master is set to local (was:

[jira] [Updated] (KYLIN-4910) Return hostname as Sparder URL address when spark master is set to local

2021-02-28 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4910: -- Summary: Return hostname as Sparder URL address when spark master is set to local (was:

[jira] [Updated] (KYLIN-4918) Support Cube Level configuration in FilePruner

2021-02-25 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4918: -- Summary: Support Cube Level configuration in FilePruner (was: Set Cube Level configuration in

[jira] [Created] (KYLIN-4918) Set Cube Level configuration in FilePruner

2021-02-25 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4918: - Summary: Set Cube Level configuration in FilePruner Key: KYLIN-4918 URL: https://issues.apache.org/jira/browse/KYLIN-4918 Project: Kylin Issue Type:

[jira] [Created] (KYLIN-4919) Use NonShardingReadRDD/ShardingReadRdd automatically for different queries

2021-02-25 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4919: - Summary: Use NonShardingReadRDD/ShardingReadRdd automatically for different queries Key: KYLIN-4919 URL: https://issues.apache.org/jira/browse/KYLIN-4919 Project:

[jira] [Commented] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-25 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291356#comment-17291356 ] ShengJun Zheng commented on KYLIN-4916: --- Close this issue and open two related issues:  KYLIN-4918,

[jira] [Updated] (KYLIN-4923) CubeMigration Tools support migrate meta from 2.x/3.x cluster to 4.0 cluster

2021-03-02 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4923: -- Description: Hi, currently we are migrating metadata of 2.x(KYLIN on HBASE) to KYLIN 4.0, the

[jira] [Created] (KYLIN-4923) CubeMigration Tools support migrate meta from 2.x/3.x cluster to 4.0 cluster

2021-03-02 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4923: - Summary: CubeMigration Tools support migrate meta from 2.x/3.x cluster to 4.0 cluster Key: KYLIN-4923 URL: https://issues.apache.org/jira/browse/KYLIN-4923

[jira] [Created] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-24 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4916: - Summary: ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks Key: KYLIN-4916 URL: https://issues.apache.org/jira/browse/KYLIN-4916

[jira] [Comment Edited] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-24 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290701#comment-17290701 ] ShengJun Zheng edited comment on KYLIN-4916 at 2/25/21, 6:05 AM: - Thanks

[jira] [Comment Edited] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-24 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290701#comment-17290701 ] ShengJun Zheng edited comment on KYLIN-4916 at 2/25/21, 6:21 AM: - Thanks

[jira] [Commented] (KYLIN-4916) ShardingReadRDD's partition number was set to shardNum,causing empty spark tasks

2021-02-24 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290701#comment-17290701 ] ShengJun Zheng commented on KYLIN-4916: --- Thanks for reply, add information for this case:    

[jira] [Updated] (KYLIN-4908) Segment pruner support integer partition col in spark query engine

2021-02-22 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4908: -- Description: 1. It's allowed to use int/bigint  partition column from hive table to divide

[jira] [Updated] (KYLIN-4908) Segment pruner support integer partition col in spark query engine

2021-02-22 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4908: -- Description: 1. It's allowed to use int/bigint  partition column from hive table to divide

[jira] [Created] (KYLIN-4912) Support setting parquet row group size at cube level

2021-02-23 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4912: - Summary: Support setting parquet row group size at cube level Key: KYLIN-4912 URL: https://issues.apache.org/jira/browse/KYLIN-4912 Project: Kylin Issue

[jira] [Closed] (KYLIN-4912) Support setting parquet row group size at cube level

2021-02-23 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng closed KYLIN-4912. - Resolution: Fixed already supported ~ > Support setting parquet row group size at cube level >

[jira] [Created] (KYLIN-4962) Fix NPE in ShrunkDict step

2021-04-08 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4962: - Summary: Fix NPE in ShrunkDict step Key: KYLIN-4962 URL: https://issues.apache.org/jira/browse/KYLIN-4962 Project: Kylin Issue Type: Bug

[jira] [Created] (KYLIN-4980) Segment pruner can't prune segments from complex filter conditions

2021-04-19 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4980: - Summary: Segment pruner can't prune segments from complex filter conditions Key: KYLIN-4980 URL: https://issues.apache.org/jira/browse/KYLIN-4980 Project: Kylin

[jira] [Updated] (KYLIN-4906) support query/job server dynamic register and discovery in kylin4

2021-02-18 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4906: -- Summary: support query/job server dynamic register and discovery in kylin4 (was: support

[jira] [Created] (KYLIN-4903) cache parent datasource to accelerate next layer's cuboid building

2021-02-06 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4903: - Summary: cache parent datasource to accelerate next layer's cuboid building Key: KYLIN-4903 URL: https://issues.apache.org/jira/browse/KYLIN-4903 Project: Kylin

[jira] [Updated] (KYLIN-4903) cache parent datasource to accelerate next layer's cuboid building

2021-02-06 Thread ShengJun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShengJun Zheng updated KYLIN-4903: -- Description: In Kylin V4, parent datasource is not cached in next layer's cuboid building,

[jira] [Created] (KYLIN-4905) Support limit .. offset ... in spark query engine

2021-02-07 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4905: - Summary: Support limit .. offset ... in spark query engine Key: KYLIN-4905 URL: https://issues.apache.org/jira/browse/KYLIN-4905 Project: Kylin Issue

[jira] [Created] (KYLIN-4908) Segment pruner support integer partition col in spark query engine

2021-02-21 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4908: - Summary: Segment pruner support integer partition col in spark query engine Key: KYLIN-4908 URL: https://issues.apache.org/jira/browse/KYLIN-4908 Project: Kylin

[jira] [Created] (KYLIN-4910) Sparder URL is hardcoded to localhost

2021-02-22 Thread ShengJun Zheng (Jira)
ShengJun Zheng created KYLIN-4910: - Summary: Sparder URL is hardcoded to localhost Key: KYLIN-4910 URL: https://issues.apache.org/jira/browse/KYLIN-4910 Project: Kylin Issue Type:

[jira] [Commented] (KYLIN-5059) Fix error when using different HDFS cluster in cube building

2021-08-10 Thread Shengjun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396543#comment-17396543 ] Shengjun Zheng commented on KYLIN-5059: --- When using different HDFS cluster in cube building jobs,

[jira] [Comment Edited] (KYLIN-5059) Fix error when using different HDFS cluster in cube building

2021-08-10 Thread Shengjun Zheng (Jira)
[ https://issues.apache.org/jira/browse/KYLIN-5059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17396543#comment-17396543 ] Shengjun Zheng edited comment on KYLIN-5059 at 8/10/21, 8:44 AM: - When

[jira] [Created] (KYLIN-5059) Fix error when using different HDFS cluster in cube building

2021-08-10 Thread Shengjun Zheng (Jira)
Shengjun Zheng created KYLIN-5059: - Summary: Fix error when using different HDFS cluster in cube building Key: KYLIN-5059 URL: https://issues.apache.org/jira/browse/KYLIN-5059 Project: Kylin