GitHub user ifilonenko opened a pull request:
https://github.com/apache/spark/pull/21583
[SPARK-23984][K8S][Test] Added Integration Tests for PySpark on Kubernetes
## What changes were proposed in this pull request?
I added integration tests for PySpark ( + checking JVM options +
RemoteFileTest) which wasn't properly merged in the initial integration test
PR.
## How was this patch tested?
I tested this with integration tests using:
`dev/dev-run-integration-tests.sh --spark-tgz
spark-2.4.0-SNAPSHOT-bin-2.7.3.tgz`
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ifilonenko/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21583.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21583
----
commit 2707dee967fd6c4cebbe96cc7ae40feb5bfced24
Author: Ilan Filonenko <if56@...>
Date: 2018-06-18T02:48:24Z
Fixed Remote File tests and added PySpark tests
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
