This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/spark-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new ccc233d Kubernetes and Minikube version upgrade (#321)
ccc233d is described below
commit ccc233da23f6fb9b3aec157ea5fe33c19cec0291
Author: Attila Zsolt Piros <2017933+attilapi...@users.noreply.github.com>
AuthorDate: Thu Mar 25 08:35:20 2021 +0100
Kubernetes and Minikube version upgrade (#321)
* Kubernetes and Minikube version update
* requiring the current context to be minikube's default
---
developer-tools.md | 11 ++++++-----
site/developer-tools.html | 11 ++++++-----
2 files changed, 12 insertions(+), 10 deletions(-)
diff --git a/developer-tools.md b/developer-tools.md
index 597b8a6..ab536bf 100644
--- a/developer-tools.md
+++ b/developer-tools.md
@@ -169,11 +169,12 @@ Please check other available options via
`python/run-tests[-with-coverage] --hel
If you have made changes to the K8S bindings in Apache Spark, it would behoove
you to test locally before submitting a PR. This is relatively simple to do,
but it will require a local (to you) installation of
[minikube](https://kubernetes.io/docs/setup/minikube/). Due to how minikube
interacts with the host system, please be sure to set things up as follows:
-- minikube version v0.34.1 (or greater, but backwards-compatibility between
versions is spotty)
-- You must use a VM driver! Running minikube with the `--vm-driver=none`
option requires that the user launching minikube/k8s have root access. Our
Jenkins workers use the
[kvm2](https://github.com/kubernetes/minikube/blob/master/docs/drivers.md#kvm2-driver)
drivers. More details
[here](https://github.com/kubernetes/minikube/blob/master/docs/drivers.md).
-- kubernetes version v1.15.12 (can be set by executing `minikube config set
kubernetes-version v1.15.12`)
+- minikube version v1.7.3 (or greater)
+- You must use a VM driver! Running minikube with the `--vm-driver=none`
option requires that the user launching minikube/k8s have root access. Our
Jenkins workers use the [kvm2](https://minikube.sigs.k8s.io/docs/drivers/kvm2/)
drivers. More details [here](https://minikube.sigs.k8s.io/docs/drivers/).
+- kubernetes version v1.17.3 (can be set by executing `minikube config set
kubernetes-version v1.17.3`)
+- the current kubernetes context must be minikube's default context (called
'minikube'). This can be selected by `minikube kubectl -- config use-context
minikube`. This is only needed when after minikube is started another
kubernetes context is selected.
-Once you have minikube properly set up, and have successfully completed the
[quick start](https://kubernetes.io/docs/setup/minikube/#quickstart), you can
test your changes locally. All subsequent commands should be run from your
root spark/ repo directory:
+Once you have minikube properly set up, and have successfully completed the
[quick start](https://minikube.sigs.k8s.io/docs/start/), you can test your
changes locally. All subsequent commands should be run from your root spark/
repo directory:
1) Build a tarball to test against:
@@ -196,7 +197,7 @@ export PVC_TESTS_HOST_PATH=$PVC_TMP_DIR
export PVC_TESTS_VM_PATH=$PVC_TMP_DIR
minikube --vm-driver=<YOUR VM DRIVER HERE> start --memory 6000 --cpus 8
-minikube config set kubernetes-version v1.15.12
+minikube config set kubernetes-version v1.17.3
minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH}
--9p-version=9p2000.L --gid=0 --uid=185 &; MOUNT_PID=$!
diff --git a/site/developer-tools.html b/site/developer-tools.html
index 9f7a93b..10b8257 100644
--- a/site/developer-tools.html
+++ b/site/developer-tools.html
@@ -348,12 +348,13 @@ Generating HTML files for PySpark coverage under
/.../spark/python/test_coverage
<p>If you have made changes to the K8S bindings in Apache Spark, it would
behoove you to test locally before submitting a PR. This is relatively simple
to do, but it will require a local (to you) installation of <a
href="https://kubernetes.io/docs/setup/minikube/";>minikube</a>. Due to how
minikube interacts with the host system, please be sure to set things up as
follows:</p>
<ul>
- <li>minikube version v0.34.1 (or greater, but backwards-compatibility
between versions is spotty)</li>
- <li>You must use a VM driver! Running minikube with the <code
class="language-plaintext highlighter-rouge">--vm-driver=none</code> option
requires that the user launching minikube/k8s have root access. Our Jenkins
workers use the <a
href="https://github.com/kubernetes/minikube/blob/master/docs/drivers.md#kvm2-driver";>kvm2</a>
drivers. More details <a
href="https://github.com/kubernetes/minikube/blob/master/docs/drivers.md";>here</a>.</li>
- <li>kubernetes version v1.15.12 (can be set by executing <code
class="language-plaintext highlighter-rouge">minikube config set
kubernetes-version v1.15.12</code>)</li>
+ <li>minikube version v1.7.3 (or greater)</li>
+ <li>You must use a VM driver! Running minikube with the <code
class="language-plaintext highlighter-rouge">--vm-driver=none</code> option
requires that the user launching minikube/k8s have root access. Our Jenkins
workers use the <a
href="https://minikube.sigs.k8s.io/docs/drivers/kvm2/";>kvm2</a> drivers. More
details <a href="https://minikube.sigs.k8s.io/docs/drivers/";>here</a>.</li>
+ <li>kubernetes version v1.17.3 (can be set by executing <code
class="language-plaintext highlighter-rouge">minikube config set
kubernetes-version v1.17.3</code>)</li>
+ <li>the current kubernetes context must be minikube’s default context
(called ‘minikube’). This can be selected by <code
class="language-plaintext highlighter-rouge">minikube kubectl -- config
use-context minikube</code>. This is only needed when after minikube is started
another kubernetes context is selected.</li>
</ul>
-<p>Once you have minikube properly set up, and have successfully completed the
<a href="https://kubernetes.io/docs/setup/minikube/#quickstart";>quick
start</a>, you can test your changes locally. All subsequent commands should
be run from your root spark/ repo directory:</p>
+<p>Once you have minikube properly set up, and have successfully completed the
<a href="https://minikube.sigs.k8s.io/docs/start/";>quick start</a>, you can
test your changes locally. All subsequent commands should be run from your
root spark/ repo directory:</p>
<p>1) Build a tarball to test against:</p>
@@ -374,7 +375,7 @@ export PVC_TESTS_HOST_PATH=$PVC_TMP_DIR
export PVC_TESTS_VM_PATH=$PVC_TMP_DIR
minikube --vm-driver=<YOUR VM DRIVER HERE> start --memory 6000 --cpus 8
-minikube config set kubernetes-version v1.15.12
+minikube config set kubernetes-version v1.17.3
minikube mount ${PVC_TESTS_HOST_PATH}:${PVC_TESTS_VM_PATH}
--9p-version=9p2000.L --gid=0 --uid=185 &; MOUNT_PID=$!
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
