This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push:
new d37f732 [SPARK-36344][CORE][SHUFFLE] Fix some typos in
ShuffleBlockPusher class
d37f732 is described below
commit d37f732a68178a053055edd5817b5a49ee109b00
Author: zhuqi-lucas <821684...@qq.com>
AuthorDate: Fri Jul 30 09:11:04 2021 +0900
[SPARK-36344][CORE][SHUFFLE] Fix some typos in ShuffleBlockPusher class
### What changes were proposed in this pull request?
Just to fix some typos in ShuffleBlockPusher class.
### Why are the changes needed?
Fix the typos, make code clear.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
No need test.
Closes #33575 from zhuqi-lucas/master.
Authored-by: zhuqi-lucas <821684...@qq.com>
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
(cherry picked from commit 900b38d5fafaf211a6ee3f72fb99ae410ef96449)
Signed-off-by: Hyukjin Kwon <gurwls...@apache.org>
---
core/src/main/scala/org/apache/spark/shuffle/ShuffleBlockPusher.scala | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git
a/core/src/main/scala/org/apache/spark/shuffle/ShuffleBlockPusher.scala
b/core/src/main/scala/org/apache/spark/shuffle/ShuffleBlockPusher.scala
index 544c753..0d2462f 100644
--- a/core/src/main/scala/org/apache/spark/shuffle/ShuffleBlockPusher.scala
+++ b/core/src/main/scala/org/apache/spark/shuffle/ShuffleBlockPusher.scala
@@ -209,7 +209,7 @@ private[spark] class ShuffleBlockPusher(conf: SparkConf)
extends Logging {
// Initiating a connection and pushing blocks to a remote shuffle
service is always handled by
// the block-push-threads. We should not initiate the connection
creation in the
// blockPushListener callbacks which are invoked by the netty eventloop
because:
- // 1. TrasportClient.createConnection(...) blocks for connection to be
established and it's
+ // 1. TransportClient.createConnection(...) blocks for connection to be
established and it's
// recommended to avoid any blocking operations in the eventloop;
// 2. The actual connection creation is a task that gets added to the
task queue of another
// eventloop which could have eventloops eventually blocking each other.
@@ -332,7 +332,7 @@ private[spark] class ShuffleBlockPusher(conf: SparkConf)
extends Logging {
* manner to make sure each target location receives shuffle blocks
belonging to the same set
* of partition ranges. 0-length blocks and blocks that are large enough
will be skipped.
*
- * @param numPartitions sumber of shuffle partitions in the shuffle file
+ * @param numPartitions number of shuffle partitions in the shuffle file
* @param partitionId map index of the current mapper
* @param shuffleId shuffleId of current shuffle
* @param dataFile shuffle data file
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
