GitHub user wgtmac reopened a pull request:
https://github.com/apache/spark/pull/15247
[SPARK-17672] Spark 2.0 history server web Ui takes too long for a single
application
## What changes were proposed in this pull request?
Added a new API getApplicationInfo(appId: String) in class
ApplicationHistoryProvider and class SparkUI to get app info. In this change,
FsHistoryProvider can directly fetch one app info in O(1) time complexity
compared to O(n) before the change which used an Iterator.find() interface.
Both ApplicationCache and OneApplicationResource classes adopt this new api.
## How was this patch tested?
manual tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/wgtmac/spark SPARK-17671
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15247.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15247
----
commit db92f16cad0de0a5a022af75cff449094742a7b6
Author: Gang Wu <[email protected]>
Date: 2016-09-26T23:26:22Z
[SPARK-17672] Spark 2.0 history server web Ui takes too long for a single
application
commit 9feb8125bbcac73f769317e77a40016eee3f0772
Author: Gang Wu <[email protected]>
Date: 2016-09-27T22:09:16Z
changed getApplicationInfo to return expected value of SparkUI
commit 7e437a1abf9b2a9461400eecea375ae6cd6043b7
Author: Gang Wu <[email protected]>
Date: 2016-09-28T01:52:33Z
fixed issue in scalastyle test
commit 67ea2de0ed7b98c8da494637ae20cb541ca0c565
Author: Gang Wu <[email protected]>
Date: 2016-09-28T19:37:59Z
use iterator.find approach in getApplicationInfo
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
