[
https://issues.apache.org/jira/browse/SPARK-11155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14961366#comment-14961366
]
Kay Ousterhout commented on SPARK-11155:
----------------------------------------
[~imranr] where exactly do you mean this is missing? I thought you meant the
Json info for StageSubmitted / StageCompleted, but that does include the stage
submission and completion time (via StageInfo), which can be used to compute
the duration.
> Stage summary json should include stage duration
> -------------------------------------------------
>
> Key: SPARK-11155
> URL: https://issues.apache.org/jira/browse/SPARK-11155
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Reporter: Imran Rashid
> Priority: Minor
> Labels: Starter
>
> The json endpoint for stages doesn't include information on the stage
> duration that is present in the UI. This looks like a simple oversight, they
> should be included. eg., the metrics should be included at
> {{api/v1/applications/<appId>/stages}}. The missing metrics are
> {{submissionTime}} and {{completionTime}} (and whatever other metrics come
> out of the discussion on SPARK-10930)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
