[
https://issues.apache.org/jira/browse/KYLIN-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17318799#comment-17318799
]
Shao Feng Shi commented on KYLIN-4967:
--------------------------------------
Zhichao, please set proper "fixed version" to avoid missing it in the release
notes.
> Forbid to set 'spark.sql.adaptive.enabled' to true when building cube with
> Spark 2.X
> ------------------------------------------------------------------------------------
>
> Key: KYLIN-4967
> URL: https://issues.apache.org/jira/browse/KYLIN-4967
> Project: Kylin
> Issue Type: Bug
> Reporter: Zhichao Zhang
> Assignee: Zhichao Zhang
> Priority: Minor
>
> With spark 2.X, when set 'spark.sql.adaptive.enabled' to true, it will impact
> the actually partition count when doing repartition with spark, which will
> lead to the wrong results for global dict and repartition by shardby column.
> For example, after writing a cuboid data, kylin will repartition the cuboid
> data with 3 partition if need, but if 'spark.sql.adaptive.enabled' is true,
> spark will optimize the partition num to 1, which leads to wrong.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
