[
https://issues.apache.org/jira/browse/SPARK-26775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756388#comment-16756388
]
shane knapp commented on SPARK-26775:
-------------------------------------
all done!
{noformat}
-bash-4.1$ pssh -i -h ubuntu_workers.txt "minikube config set
kubernetes-version v1.10.0"
[1] 10:24:44 [SUCCESS] amp-jenkins-staging-worker-02
[2] 10:24:44 [SUCCESS] amp-jenkins-staging-worker-01
[3] 10:24:44 [SUCCESS] research-jenkins-worker-07
[4] 10:24:44 [SUCCESS] research-jenkins-worker-08
{noformat}
...and for testing:
{noformat}
jenkins@ubuntu-testing:~$ minikube config set kubernetes-version v1.10.0
jenkins@ubuntu-testing:~$ minikube --vm-driver=kvm2 start --memory 6000 --cpus 8
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Downloading localkube binary
173.54 MB / 173.54 MB [============================================] 100.00% 0s
0 B / 65 B [----------------------------------------------------------] 0.00%
65 B / 65 B [======================================================] 100.00%
0sSetting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
Kubectl is now configured to use the cluster.
Loading cached images from config file.
{noformat}
> Update Jenkins nodes to support local volumes for K8s integration tests
> -----------------------------------------------------------------------
>
> Key: SPARK-26775
> URL: https://issues.apache.org/jira/browse/SPARK-26775
> Project: Spark
> Issue Type: Improvement
> Components: jenkins, Kubernetes
> Affects Versions: 3.0.0
> Reporter: Stavros Kontopoulos
> Assignee: shane knapp
> Priority: Major
>
> Current version of Minikube on test machines does not support properly the
> local persistent volume feature required by this PR:
> [https://github.com/apache/spark/pull/23514].
> We get his error:
> "spec.local: Forbidden: Local volumes are disabled by feature-gate,
> metadata.annotations: Required value: Local volume requires node affinity"
> This is probably due to this:
> [https://github.com/rancher/rancher/issues/13864] which implies that we need
> to update to 1.10+ as described in
> [https://kubernetes.io/docs/concepts/storage/volumes/#local]. Fabric8io
> client is already updated in the PR mentioned at the beginning.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]