Matt Cheah created SPARK-28764:
----------------------------------
Summary: Remove unnecessary writePartitionedFile method from
ExternalSorter
Key: SPARK-28764
URL: https://issues.apache.org/jira/browse/SPARK-28764
Project: Spark
Issue Type: Task
Components: Shuffle, Tests
Affects Versions: 3.0.0
Reporter: Matt Cheah
Following SPARK-28571, we now use {{ExternalSorter#writePartitionedData}} in
{{SortShuffleWriter}} when persisting the shuffle data via the shuffle writer
plugin. However, we left the {{writePartitionedFile}} method on
{{ExternalSorter}} strictly for tests. We should figure out a way how to
refactor those tests to use {{writePartitionedData}} instead of
{{writePartitionedFile}}.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
