This is an automated email from the ASF dual-hosted git repository.
zhouky pushed a commit to branch branch-0.3
in repository https://gitbox.apache.org/repos/asf/incubator-celeborn.git
The following commit(s) were added to refs/heads/branch-0.3 by this push:
new 627bc55e7 [CELEBORN-656] Should also refine log about return
HARD_SPLIT in handlePushMergedData
627bc55e7 is described below
commit 627bc55e7cf4ae124673a80c587b547ed732c17a
Author: Angerszhuuuu <[email protected]>
AuthorDate: Mon Jul 24 20:43:56 2023 +0800
[CELEBORN-656] Should also refine log about return HARD_SPLIT in
handlePushMergedData
### What changes were proposed in this pull request?
As title
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
Closes #1756 from AngersZhuuuu/CELEBORN-656-FOLLOWUP.
Authored-by: Angerszhuuuu <[email protected]>
Signed-off-by: zky.zhoukeyong <[email protected]>
(cherry picked from commit 6427ed35cd63497191cfc13e7675710a4aa82d96)
Signed-off-by: zky.zhoukeyong <[email protected]>
---
.../org/apache/celeborn/service/deploy/worker/PushDataHandler.scala | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git
a/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala
b/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala
index bb54a2f8c..f93d46d60 100644
---
a/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala
+++
b/worker/src/main/scala/org/apache/celeborn/service/deploy/worker/PushDataHandler.scala
@@ -448,7 +448,7 @@ class PushDataHandler extends BaseMessageHandler with
Logging {
callbackWithTimer.onSuccess(
ByteBuffer.wrap(Array[Byte](StatusCode.STAGE_ENDED.getValue)))
} else {
- logInfo(s"Receive push merged data for committed hard split
partition of " +
+ logInfo(s"[Case1] Receive push merged data for committed hard
split partition of " +
s"(shuffle $shuffleKey, map $mapId attempt $attemptId)")
callbackWithTimer.onSuccess(
ByteBuffer.wrap(Array[Byte](StatusCode.HARD_SPLIT.getValue)))
@@ -458,7 +458,7 @@ class PushDataHandler extends BaseMessageHandler with
Logging {
// If there is no shuffle key in shuffleMapperAttempts but there
is shuffle key
// in StorageManager. This partition should be HARD_SPLIT
partition and
// after worker restart, some tasks still push data to this
HARD_SPLIT partition.
- logInfo(s"Receive push merged data for committed hard split
partition of " +
+ logInfo(s"[Case2] Receive push merged data for committed hard
split partition of " +
s"(shuffle $shuffleKey, map $mapId attempt $attemptId)")
callbackWithTimer.onSuccess(
ByteBuffer.wrap(Array[Byte](StatusCode.HARD_SPLIT.getValue)))