GitHub user carlosfuertes opened a pull request:
https://github.com/apache/spark/pull/1682
Spark 2017
I address here issues SPARK-2017 and SPARK-2016 by serving the data for the
tables as JSON further rendering under Spark UI web interface.
Main addition is exposing paths with the JSON data as:
/stages/stage/tasks/json/?id=nnn
/storage/json
/storage/rdd/workers/json?id=nnn
/storage/rdd/blocks/json?id=nnn
and using javascript to built the tables from an ajax request of those JSON.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/carlosfuertes/spark SPARK-2017
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1682.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1682
----
commit 458cae4ab065a0e173e0f9dd2c075addafabd9a7
Author: carlosfuertes <[email protected]>
Date: 2014-07-28T05:24:41Z
json output for storage/rdd
commit 40a49c36516a261936fd8d591ec864646ec3f1ae
Author: carlosfuertes <[email protected]>
Date: 2014-07-28T06:12:11Z
small refactoring to keep code dry
commit 7e6ce37a601f7b58ab25351c366f213a7e159cb7
Author: carlosfuertes <[email protected]>
Date: 2014-07-29T05:54:18Z
storage tab is using completely JSON to render all data
commit 3d5f1ddf210d07821e2ba6177a04f338972e7109
Author: carlosfuertes <[email protected]>
Date: 2014-07-29T05:55:08Z
Merge remote-tracking branch 'upstream/master' into SPARK-2017
commit 469320603e1aca5c10fc59ff3fe3443ad9f4c9ce
Author: carlosfuertes <[email protected]>
Date: 2014-07-29T06:08:56Z
made code pass style guidelines
commit f4ebcdbcca0ecefb4f4c990c35810a388c8e7bc0
Author: carlosfuertes <[email protected]>
Date: 2014-07-29T12:27:41Z
added expanding arrays in JSON for html tables into javascript function
commit f20560041468f1c0a59051cc960a94c58ebc138d
Author: carlosfuertes <[email protected]>
Date: 2014-07-30T02:29:56Z
Merge remote-tracking branch 'upstream/master' into SPARK-2017
commit 84d8628df35f01bc9ff818e0026a8cda6140bdf4
Author: carlosfuertes <[email protected]>
Date: 2014-07-30T05:11:21Z
adding tasks table under stage Spark UI from JSON. First pass
commit 6e787f60c670db77a2e1c7be3980ca7493b9ede9
Author: carlosfuertes <[email protected]>
Date: 2014-07-30T06:52:25Z
added sorttable custom key to json
commit 11e33836bc89932b1d5a4919394170e030329b57
Author: carlosfuertes <[email protected]>
Date: 2014-07-30T13:09:30Z
fixed sorttable to sort tables again
commit 7b0bde38371fe0e12d4cee52336ead6dff819d37
Author: carlosfuertes <[email protected]>
Date: 2014-07-31T02:31:47Z
Merge remote-tracking branch 'upstream/master' into SPARK-2017
commit 5aa4b283010a1eaaf48d09399ed16bf5aafb4726
Author: carlosfuertes <[email protected]>
Date: 2014-07-31T05:19:38Z
added a proper JSON handling of sorttable_custom key
commit 384ff1a567eadeefa72d28d5fedd9260a1874d3f
Author: carlosfuertes <[email protected]>
Date: 2014-07-31T05:22:27Z
deleted commented code
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
