Bharati Jadhav created SPARK-29596:
--------------------------------------
Summary: Task duration not updating for running tasks
Key: SPARK-29596
URL: https://issues.apache.org/jira/browse/SPARK-29596
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 2.4.2
Reporter: Bharati Jadhav
When looking at the task metrics for running tasks in the task table for the
related stage, the duration column is not updated until the task has succeeded.
The duration values are reported empty or 0 ms until the task has completed.
This is a change in behavior, from earlier versions, when the task duration was
continuously updated while the task was running. The missing duration values
can be observed for both short and long running tasks and for multiple
applications.
To reproduce this, one can run any code from the spark-shell and observe the
missing duration values for any running task. Only when the task succeeds is
the duration value populated in the UI.
!image-2019-10-24-14-16-16-986.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
