GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/5940
[SPARK-3454] seperate json endpoints for data in the UI
Exposes data available in the UI as json over http. Key points:
* new endpoints, handled independently of existing XyzPage classes. Root
entrypoint is `JsonRootResource`
* Uses jersey + jackson for routing & converting POJOs into json
* tests against known results in `HistoryServerSuite`
* also fixes some minor issues w/ the UI -- synchronizing on access to
`StorageListener` & `StorageStatusListener`, and fixing some inconsistencies w/
the way we handle retained jobs & stages.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/squito/spark SPARK-3454_better_test_files
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5940.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5940
----
commit 863ef643f881e2e47d200783cf11eec9503d404b
Author: Imran Rashid <[email protected]>
Date: 2015-05-06T02:35:40Z
rename json files to avoid strange file names and not look like php
commit 4e12013d5967e5ee7c9a4a4709565e1d07774d97
Author: Imran Rashid <[email protected]>
Date: 2015-05-06T02:40:40Z
just use test case name for expectation file name
commit 12769003258d7d9b3e05e986166bda1e392f1874
Author: Imran Rashid <[email protected]>
Date: 2015-05-06T13:28:48Z
get rid of giant event file, replace w/ smaller one; check both shuffle
read & shuffle write
commit 1fc65b03bc419270744d9aac3bc71a37d9162801
Author: Imran Rashid <[email protected]>
Date: 2015-05-06T13:32:11Z
Revert "Revert "[SPARK-3454] separate json endpoints for data in the UI""
This reverts commit 51b3d41e160a1326a04536241b427e65b39ed8df.
commit 85fdb3ee6bb39fd2334417f52b6c1607b3e38bb7
Author: Imran Rashid <[email protected]>
Date: 2015-05-06T13:32:18Z
Merge branch 'no_php' into SPARK-3454
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
