GitHub user foxish opened a pull request:
https://github.com/apache/spark/pull/19468
[SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Scheduler Backend
## What changes were proposed in this pull request?
This change adds in a stripped down version of the
`KubernetesClusterSchedulerBackend` for Spark.
It's step 1 from the step-wise plan documented
[here](https://github.com/apache-spark-on-k8s/spark/issues/441#issuecomment-330802935).
This addition is covered by the [SPIP
vote](http://apache-spark-developers-list.1001551.n3.nabble.com/SPIP-Spark-on-Kubernetes-td22147.html)
which passed on Aug 31 .
## How was this patch tested?
- The patch contains unit tests which are passing.
- Manual testing: `./build/mvn -Pkubernetes clean package` succeeded.
- It is a **subset** of the entire changelist hosted in
http://github.com/apache-spark-on-k8s/spark which is under active use in
several organizations.
- There is integration testing enabled in the fork currently [hosted by
PepperData](spark-k8s-jenkins.pepperdata.org:8080) which is being moved over to
RiseLAB CI.
- Detailed documentation on trying out the patch in its entirety is in:
https://apache-spark-on-k8s.github.io/userdocs/running-on-kubernetes.html
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache-spark-on-k8s/spark spark-kubernetes-3
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19468.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19468
----
commit f6fdd6a40b38b413cd55e2315dd9fb5bc6ca575c
Author: foxish <[email protected]>
Date: 2017-09-15T03:10:24Z
Spark on Kubernetes - basic scheduler backend
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
