GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/20644
[SPARK-23470][ui] Use first attempt of last stage to define job description.
This is much faster than finding out what the last attempt is, and the
data should be the same.
There's room for improvement in this page (like only loading data for
the jobs being shown, instead of loading all available jobs and sorting
them), but this should bring performance on par with the 2.2 version.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-23470
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20644.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20644
----
commit 0dc95ad83e9d736dedbb5d09d18513508847c0e4
Author: Marcelo Vanzin <vanzin@...>
Date: 2018-02-20T21:51:55Z
[SPARK-23470][ui] Use first attempt of last stage to define job description.
This is much faster than finding out what the last attempt is, and the
data should be the same.
There's room for improvement in this page (like only loading data for
the jobs being shown, instead of loading all available jobs and sorting
them), but this should bring performance on par with the 2.2 version.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
