[
https://issues.apache.org/jira/browse/SPARK-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kay Ousterhout updated SPARK-3984:
----------------------------------
Description:
Right now, the UI does not display the time to deserialize the task, which can
be significant when running short jobs (e.g., ML).
cc [~sparks] [~shivaram]
was:
Right now, the UI does not display the time to deserialize the task, to
serialize the task result, or to launch a new thread for the task. When
running short jobs (e.g., for ML) these overheads can become significant. It
would be great to show these in the summary quantiles for each stage in the UI
to facilitate better performance debugging.
cc [~sparks] [~shivaram]
Summary: Display task deserialization time in the UI (was: Display
finer grained metrics about task launch overhead in the UI)
> Display task deserialization time in the UI
> -------------------------------------------
>
> Key: SPARK-3984
> URL: https://issues.apache.org/jira/browse/SPARK-3984
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Reporter: Kay Ousterhout
> Assignee: Kay Ousterhout
> Fix For: 1.2.0
>
>
> Right now, the UI does not display the time to deserialize the task, which
> can be significant when running short jobs (e.g., ML).
> cc [~sparks] [~shivaram]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
