L. C. Hsieh created SPARK-35637:
-----------------------------------
Summary: 2 active tasks shown in Spark UI but executor core is 1
and task cpu is 1
Key: SPARK-35637
URL: https://issues.apache.org/jira/browse/SPARK-35637
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 3.0.2
Reporter: L. C. Hsieh
We see an incorrect element on UI. We set executor core as 1, and task cpu as
1, but we sometimes see 2 active tasks for one executor in "Executors" tab on
Spark UI.
It seems to be UI-only issue, because from the event timeline diagram, two
tasks are not actually run at the same time. The second one begins to run after
first one finishes.
Note that two tasks have very short duration 0.7s and 1s.
So it looks like there is a delay on UI to reflect correct active tasks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]