Venkata krishnan Sowrirajan created SPARK-33481:
---------------------------------------------------
Summary: Better heuristics to compute number of shuffle mergers
required for a ShuffleMapStage
Key: SPARK-33481
URL: https://issues.apache.org/jira/browse/SPARK-33481
Project: Spark
Issue Type: Sub-task
Components: Shuffle, Spark Core
Affects Versions: 3.1.0
Reporter: Venkata krishnan Sowrirajan
Currently we have a naive way of computing the number of shuffle mergers
required for a ShuffleMapStage by considering the resulting number of
partitions. This needs to be further brainstormed and enhanced.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
