This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new c6793fd4847 [SPARK-46133][CORE][DOCS] Make
`ShuffleWriteProcessor.write` method description up-to-date
c6793fd4847 is described below
commit c6793fd484756d6eabf7ea8bf9ae665e361fc95b
Author: zwangsheng <binjiey...@apache.org>
AuthorDate: Wed Nov 29 13:42:26 2023 -0800
[SPARK-46133][CORE][DOCS] Make `ShuffleWriteProcessor.write` method
description up-to-date
### What changes were proposed in this pull request?
Modify comment for `ShuffleWriteProcessor.write`
### Why are the changes needed?
After [SPARK-44605](https://github.com/apache/spark/pull/42234), we move
`rdd.iterator(partition, context)` from `ShuffleWriteProcessor#write` to
`ShuffleMapTask#runTask`.
We should modify the comments synchronously.
### Does this PR introduce _any_ user-facing change?
No, make comment right for developers
### How was this patch tested?
No need
### Was this patch authored or co-authored using generative AI tooling?
No
Closes #44054 from zwangsheng/SPARK-46133.
Authored-by: zwangsheng <binjiey...@apache.org>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
.../main/scala/org/apache/spark/shuffle/ShuffleWriteProcessor.scala | 3 +--
1 file changed, 1 insertion(+), 2 deletions(-)
diff --git
a/core/src/main/scala/org/apache/spark/shuffle/ShuffleWriteProcessor.scala
b/core/src/main/scala/org/apache/spark/shuffle/ShuffleWriteProcessor.scala
index 1ee32b92109..1ab77643c03 100644
--- a/core/src/main/scala/org/apache/spark/shuffle/ShuffleWriteProcessor.scala
+++ b/core/src/main/scala/org/apache/spark/shuffle/ShuffleWriteProcessor.scala
@@ -37,8 +37,7 @@ private[spark] class ShuffleWriteProcessor extends
Serializable with Logging {
/**
* The write process for particular partition, it controls the life circle
of [[ShuffleWriter]]
- * get from [[ShuffleManager]] and triggers rdd compute, finally return the
[[MapStatus]] for
- * this task.
+ * get from [[ShuffleManager]] finally return the [[MapStatus]] for this
task.
*/
def write(
inputs: Iterator[_],
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
