This is an automated email from the ASF dual-hosted git repository.
jiangxb1987 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new f950e53 [MINOR][CORE] Update taskName in PythonRunner
f950e53 is described below
commit f950e539304dffc01c3f3c48c2d369e54e301587
Author: Xingbo Jiang <[email protected]>
AuthorDate: Thu May 2 15:37:25 2019 -0700
[MINOR][CORE] Update taskName in PythonRunner
## What changes were proposed in this pull request?
Update taskName in PythonRunner so it keeps align with that in Executor.
## How was this patch tested?
N/A
Closes #24510 from jiangxb1987/pylog.
Authored-by: Xingbo Jiang <[email protected]>
Signed-off-by: Xingbo Jiang <[email protected]>
---
core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
b/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
index b7f14e0..fabd6fd 100644
--- a/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
+++ b/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
@@ -511,7 +511,7 @@ private[spark] abstract class BasePythonRunner[IN, OUT](
if (!context.isCompleted) {
try {
// Mimic the task name used in `Executor` to help the user find
out the task to blame.
- val taskName = s"${context.partitionId}.${context.taskAttemptId} "
+
+ val taskName = s"${context.partitionId}.${context.attemptNumber} "
+
s"in stage ${context.stageId} (TID ${context.taskAttemptId})"
logWarning(s"Incomplete task $taskName interrupted: Attempting to
kill Python Worker")
env.destroyPythonWorker(pythonExec, envVars.asScala.toMap, worker)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
