GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/3009
[SPARK-4145] [WIP] Web UI job pages
This PR adds two new pages to the Spark Web UI:
- A jobs overview page, which shows details on running / completed / failed
jobs.
- A job details page, which displays information on an individual job's
stages.
The jobs overview page is now the default UI homepage; the old homepage is
still accessible at /stages.
In some situations, the jobs page may display "No information on stage" for
some stages of pending jobs that have not begun executing. This is due to some
limitations in how JobProgressListener finds out about stages. We can address
this later as part of a separate scheduler PR.
### Screenshots
#### New UI homepage
#### Job details page
(This is effectively a per-job version of the stages page that can be
extended later with other things, such as DAG visualizations)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark job-page
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/3009.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3009
----
commit 2568a6cfcf5287e29d0e4be58280aa7b934b01a7
Author: Josh Rosen <[email protected]>
Date: 2014-10-29T22:27:16Z
Rename JobProgressPage to AllStagesPage:
This will avoid confusion once we have a page that lists all jobs.
commit 4487dcbe9df550ee054f2ba546ce0553ae40d103
Author: Josh Rosen <[email protected]>
Date: 2014-10-30T00:53:51Z
[SPARK-4145] Web UI job pages
This PR adds two new pages to the Spark Web UI:
- A jobs overview page, which shows details on running / completed / failed
jobs.
- A job details page, which displays information on an individual job's
stages.
The jobs overview page is now the default UI homepage; the old homepage is
still accessible at /stages.
In some situations, the jobs page may display "No information on stage" for
some stages of pending jobs that have not begun executing. This is due to
some
limitations in how JobProgressListener finds out about stages. We can
address
this later as part of a separate scheduler PR.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
