[
https://issues.apache.org/jira/browse/SPARK-36378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wuyi resolved SPARK-36378.
--------------------------
Fix Version/s: 3.3.0
3.2.0
Assignee: Min Shen
Resolution: Fixed
Issue resolved by https://github.com/apache/spark/pull/33613
> Minor changes to address a few identified server side inefficiencies
> --------------------------------------------------------------------
>
> Key: SPARK-36378
> URL: https://issues.apache.org/jira/browse/SPARK-36378
> Project: Spark
> Issue Type: Sub-task
> Components: Shuffle, Spark Core
> Affects Versions: 3.2.0
> Reporter: Min Shen
> Assignee: Min Shen
> Priority: Major
> Fix For: 3.2.0, 3.3.0
>
>
> With the SPIP ticket close to being finished, we have done some performance
> evaluations to compare the performance of push-based shuffle in upstream
> Spark with the production version we have internally at LinkedIn.
> The evaluations have revealed a few regressions and also some additional perf
> improvement opportunity.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]