[
https://issues.apache.org/jira/browse/SPARK-22539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22539:
------------------------------------
Assignee: (was: Apache Spark)
> Add second order for rangepartitioner since partition number may be small if
> the specified key is skewed
> --------------------------------------------------------------------------------------------------------
>
> Key: SPARK-22539
> URL: https://issues.apache.org/jira/browse/SPARK-22539
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.1.0
> Reporter: zhoukang
>
> The rangepartitioner generated from shuffle exchange may cause partiton skew
> if sort key is skewed.
> We can add second order for rangepartitioner since partition number may be
> small if the specified key is skewed.
> This improvement comes from real case.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
