GitHub user ssuchter opened a pull request:
https://github.com/apache/spark/pull/20697
Initial checkin of k8s integration tests.
These tests were developed in the
https://github.com/apache-spark-on-k8s/spark-integration repo
by several contributors. This is a copy of the current state into the main
apache spark repo.
The only changes from the current spark-integration repo state are:
* Move the files from the repo root into
resource-managers/kubernetes/integration-tests
* Add a reference to these tests in the root README.md
* Fix a path reference in dev/dev-run-integration-tests.sh
* Add a TODO in include/util.sh
## What changes were proposed in this pull request?
Incorporation of Kubernetes integration tests.
## How was this patch tested?
This code has its own unit tests, but the main purpose is to provide the
integration tests.
I tested this on my laptop by running dev/dev-run-integration-tests.sh
--spark-tgz ~/spark-2.4.0-SNAPSHOT-bin--.tgz
The spark-integration tests have already been running for months in AMPLab,
here is an example:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-scheduled-spark-integration-master/
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ssuchter/spark ssuchter-k8s-integration-tests
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20697.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20697
----
commit 2c5305128eb5d2e7847a0b6df67b7068d7f0ad8f
Author: Sean Suchter <ssuchter@...>
Date: 2018-02-28T20:10:46Z
Initial checkin of k8s integration tests.
These tests were developed in the
https://github.com/apache-spark-on-k8s/spark-integration repo
by several contributors. This is a copy of the current state into the main
apache spark repo.
The only changes from the current spark-integration repo state are:
* Move the files from the repo root into
resource-managers/kubernetes/integration-tests
* Add a reference to these tests in the root README.md
* Fix a path reference in dev/dev-run-integration-tests.sh
* Add a TODO in include/util.sh
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]