GitHub user redsanket opened a pull request:
https://github.com/apache/spark/pull/17658
[SPARK-20355] Add per application spark version on the history server
headerpage
## What changes were proposed in this pull request?
Spark Version for a specific application is not displayed on the history
page now. It should be nice to switch the spark version on the UI when we click
on the specific application.
Currently there seems to be way as SparkListenerLogStart records the
application version. So, it should be trivial to listen to this event and
provision this change on the UI.
For Example
<img width="1438" alt="screen shot 2017-04-06 at 3 23 50 pm"
src="https://cloud.githubusercontent.com/assets/8295799/25092588/fd53325e-2353-11e7-9ac7-ba304f81ba1a.png">
<img width="1439" alt="screen shot 2017-04-06 at 3 24 03 pm"
src="https://cloud.githubusercontent.com/assets/8295799/25092595/0549aace-2354-11e7-80a7-e044da2d5e0f.png">
{"Event":"SparkListenerLogStart","Spark Version":"2.0.0"}
(Please fill in changes proposed in this fix)
Modified the SparkUI for History server to listen to SparkLogListenerStart
event and extract the version and print it.
## How was this patch tested?
Manual testing of UI page. Attaching the UI screenshot changes here
(Please explain how this patch was tested. E.g. unit tests, integration
tests, manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/redsanket/spark SPARK-20355
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17658.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17658
----
commit 1f50b2750714bfcb2c77b9932ed7c5fca3d7cfa3
Author: Sanket <schintap@untilservice-lm>
Date: 2017-04-06T13:50:22Z
Add per application spark version on the history server headerpage
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]