[
https://issues.apache.org/jira/browse/SPARK-28764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-28764:
------------------------------------
Assignee: Matt Cheah
> Remove unnecessary writePartitionedFile method from ExternalSorter
> ------------------------------------------------------------------
>
> Key: SPARK-28764
> URL: https://issues.apache.org/jira/browse/SPARK-28764
> Project: Spark
> Issue Type: Task
> Components: Shuffle, Spark Core, Tests
> Affects Versions: 3.0.0
> Reporter: Matt Cheah
> Assignee: Matt Cheah
> Priority: Minor
>
> Following SPARK-28571, we now use {{ExternalSorter#writePartitionedData}} in
> {{SortShuffleWriter}} when persisting the shuffle data via the shuffle writer
> plugin. However, we left the {{writePartitionedFile}} method on
> {{ExternalSorter}} strictly for tests. We should figure out a way how to
> refactor those tests to use {{writePartitionedData}} instead of
> {{writePartitionedFile}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
