[ https://issues.apache.org/jira/browse/SPARK-23389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan resolved SPARK-23389. --------------------------------- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 20576 [https://github.com/apache/spark/pull/20576] > When the shuffle dependency specifies aggregation ,and > `dependency.mapSideCombine=false`, we should be able to use serialized > sorting. > --------------------------------------------------------------------------------------------------------------------------------------- > > Key: SPARK-23389 > URL: https://issues.apache.org/jira/browse/SPARK-23389 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 2.3.0 > Reporter: liuxian > Assignee: liuxian > Priority: Major > Fix For: 2.4.0 > > > When the shuffle dependency specifies aggregation ,and > `dependency.mapSideCombine=false`, in the map side,there is no need for > aggregation and sorting, so we should be able to use serialized sorting. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org