GitHub user skonto opened a pull request:
https://github.com/apache/spark/pull/18528
[SPARK-13041][Mesos] Adds sandbox uri to spark dispatcher ui
## What changes were proposed in this pull request?
Adds a sandbox link per driver in the dispatcher ui with minimal changes
after a bug was fixed here:
https://issues.apache.org/jira/browse/MESOS-4992
The sandbox uri has the following format:
http://<proxy_uri>/#/slaves/<agent-id>/frameworks/<scheduler-id>/executors/<driver-id>/browse
For dc/os the proxy uri is <dc/os uri>/mesos. For the dc/os deployment
scenario and to make things easier I introduced a new config property named
`spark.mesos.proxy.base_url` which should be passed to the dispatcher when
launched using --conf. If no such configuration is detected then no sandbox uri
is depicted. Within dc/os this must be a property for the dispatcher that we
should add in the future here:
https://github.com/mesosphere/universe/blob/9e7c909c3b8680eeb0494f2a58d5746e3bab18c1/repo/packages/S/spark/26/config.json
It is not easy to detect in different environemnts what is that uri so user
should pass it.
## How was this patch tested?
Tested with the mesos test suite here:
https://github.com/typesafehub/mesos-spark-integration-tests.
Attached image shows the ui modification.
The final test will be with mesos 1.4 as this is the version where the bug
is fixed check again here:
https://issues.apache.org/jira/browse/MESOS-4992
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/skonto/spark adds_the_sandbox_uri
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18528.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18528
----
commit ed0f0010abeec3fc0ebe4a233ca58ca420abd233
Author: Stavros Kontopoulos <[email protected]>
Date: 2017-07-04T13:04:26Z
add sandbox uri
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
