This is an automated email from the ASF dual-hosted git repository.
yao pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 54f15721649d [SPARK-47314][DOC] Remove the wrong comment line of
`ExternalSorter#writePartitionedMapOutput` method
54f15721649d is described below
commit 54f15721649d8cb094043b8b6f45985a8005ad55
Author: zwangsheng <[email protected]>
AuthorDate: Fri Mar 8 10:04:38 2024 +0800
[SPARK-47314][DOC] Remove the wrong comment line of
`ExternalSorter#writePartitionedMapOutput` method
### What changes were proposed in this pull request?
Correct the comment of `ExternalSorter#writePartitionedMapOutput`.
`ExternalSorter#writePartitionedMapOutput` return nothing, and will update
the partition's length when call partition pair writer to close.
### Why are the changes needed?
Correct comment.
### Does this PR introduce _any_ user-facing change?
No, developers will meet this change in source code.
### How was this patch tested?
No need.
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #45415 from zwangsheng/SPARK-47314.
Authored-by: zwangsheng <[email protected]>
Signed-off-by: Kent Yao <[email protected]>
---
.../main/scala/org/apache/spark/util/collection/ExternalSorter.scala | 2 --
1 file changed, 2 deletions(-)
diff --git
a/core/src/main/scala/org/apache/spark/util/collection/ExternalSorter.scala
b/core/src/main/scala/org/apache/spark/util/collection/ExternalSorter.scala
index 9db7fd18b07a..77aec10a6b12 100644
--- a/core/src/main/scala/org/apache/spark/util/collection/ExternalSorter.scala
+++ b/core/src/main/scala/org/apache/spark/util/collection/ExternalSorter.scala
@@ -689,8 +689,6 @@ private[spark] class ExternalSorter[K, V, C](
/**
* Write all the data added into this ExternalSorter into a map output
writer that pushes bytes
* to some arbitrary backing store. This is called by the SortShuffleWriter.
- *
- * @return array of lengths, in bytes, of each partition of the file (used
by map output tracker)
*/
def writePartitionedMapOutput(
shuffleId: Int,
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
