GitHub user XuTingjun opened a pull request:
https://github.com/apache/spark/pull/6545
[SPARK-7889] make sure click the "App ID" on HistoryPage, the SparkUI will
be refreshed.
The bug is that: When clicking the app in incomplete page, the tasks
progress is 100/2000. After the app finished, click into the app again, the
tasks progress still shows 100/2000.
This patch I override the handle function in UIHandlerCollection. I just
add the line 137-151, to make sure every time click the "App ID" , the
HistoryPage will read the event file on hdfs, and refresh the SparkUI.
May have two problems:
1. Though it makes the SparkUI can refresh, but the refresh is effective
just after clicking the "App ID". If have entered the SparkUI, refresh makes no
change.
2. every time click the "App ID", it will go to read the hdfs file. So it
will make response more slower and have the risk of being attacked.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/XuTingjun/spark SPARK-7889
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6545.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6545
----
commit 9d5c1baa4acfe66e04dc58a4ece5a97792db8749
Author: Xutingjun <[email protected]>
Date: 2015-06-01T02:01:29Z
To make sure every time click the "App ID" on HistoryPage, the SparkUI will
be refreshed.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
