GitHub user keypointt opened a pull request:
https://github.com/apache/spark/pull/10107
[SPARK-11155][Web UI] Stage summary json should include stage duration
The json endpoint for stages doesn't include information on the stage
duration that is present in the UI. This looks like a simple oversight, they
should be included. eg., the metrics should be included at
api/v1/applications/<appId>/stages.
Metrics I've added are: submissionTime, firstTaskLaunchedTime and
completionTime
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/keypointt/spark SPARK-11155
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10107.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10107
----
commit e46cf1568e596ca23209f090f622e98a5223d71c
Author: Xin Ren <[email protected]>
Date: 2015-12-01T00:56:03Z
[SPARK-11155] add missing metrics, but still don't know where to extract
from
commit 85f5be402f6b0fb772824c630443bb35fc077f1d
Author: Xin Ren <[email protected]>
Date: 2015-12-01T23:12:02Z
[SPARK-11155] 'firstTaskLaunchedTime' seems working on my local machine but
bad practise, should be a variable in class UiData somehow. besides, don't know
how to extract 'maximumDurationOfAllTasks'
commit f3f76ba933344d97dda71e807f90d928e6fe1fa3
Author: Xin Ren <[email protected]>
Date: 2015-12-02T00:28:26Z
[SPARK-11155] 'maximumDurationOfAllTasks' is for StageTable, remove this
metric
commit 2cc1556584e6e9f4efe2b25253a9432601f6abad
Author: Xin Ren <[email protected]>
Date: 2015-12-02T00:55:52Z
[SPARK-11155] style correction: File line length exceeds 100 characters
commit cdf9c1270a7ab585f139125a83d2801052606e9d
Author: Xin Ren <[email protected]>
Date: 2015-12-02T17:56:33Z
[SPARK-11155] change from epoch time to Date() format
commit 0b6b7bf0e432cf81d07ac0c1791583dea2ff3fd0
Author: Xin Ren <[email protected]>
Date: 2015-12-02T18:49:46Z
[SPARK-11155] fix test cases for HistoryServerSuite
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
