[
https://issues.apache.org/jira/browse/SPARK-24076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16451727#comment-16451727
]
yucai commented on SPARK-24076:
-------------------------------
The query example:
{code:sql}
insert overwrite table target_xxx
SELECT
item_id,
auct_end_dt
FROM
(select cast(item_id as double) as item_id, auct_end_dt from source_xxx
GROUP BY
item_id,
auct_end_dt
{code}
> very bad performance when shuffle.partition = 8192
> --------------------------------------------------
>
> Key: SPARK-24076
> URL: https://issues.apache.org/jira/browse/SPARK-24076
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.3.0
> Reporter: yucai
> Priority: Major
> Attachments: p1.png, p2.png
>
>
> We see very bad performance when shuffle.partition = 8192 on some cases.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
