[
https://issues.apache.org/jira/browse/SPARK-26775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756415#comment-16756415
]
shane knapp edited comment on SPARK-26775 at 1/30/19 7:23 PM:
--------------------------------------------------------------
ill install the latest version on my test worker and run a couple of builds to
check for compatibility... it should be fine...
...i hope. :)
this is definitely out of scope for this issue btw and it won't be a gating
factor for resolving this.
also, i launched a test for the new k8s version:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/7593/
-looks good so far!- the build failed, sadly:
{noformat}
- Test PVs with local storage *** FAILED ***
The code passed to eventually never returned normally. Attempted 64 times
over 2.01437391135 minutes. Last failure message: container not found
("spark-kubernetes-driver"). (PVTestsSuite.scala:119)
{noformat}
was (Author: shaneknapp):
ill install the latest version on my test worker and run a couple of builds to
check for compatibility... it should be fine...
...i hope. :)
this is definitely out of scope for this issue btw and it won't be a gating
factor for resolving this.
also, i launched a test for the new k8s version:
https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/7593/
looks good so far!
> Update Jenkins nodes to support local volumes for K8s integration tests
> -----------------------------------------------------------------------
>
> Key: SPARK-26775
> URL: https://issues.apache.org/jira/browse/SPARK-26775
> Project: Spark
> Issue Type: Improvement
> Components: jenkins, Kubernetes
> Affects Versions: 3.0.0
> Reporter: Stavros Kontopoulos
> Assignee: shane knapp
> Priority: Major
>
> Current version of Minikube on test machines does not support properly the
> local persistent volume feature required by this PR:
> [https://github.com/apache/spark/pull/23514].
> We get his error:
> "spec.local: Forbidden: Local volumes are disabled by feature-gate,
> metadata.annotations: Required value: Local volume requires node affinity"
> This is probably due to this:
> [https://github.com/rancher/rancher/issues/13864] which implies that we need
> to update to 1.10+ as described in
> [https://kubernetes.io/docs/concepts/storage/volumes/#local]. Fabric8io
> client is already updated in the PR mentioned at the beginning.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
