skonto opened a new pull request #23514: [SPARK-24902][K8s] add PV integration tests URL: https://github.com/apache/spark/pull/23514 ## What changes were proposed in this pull request? - Adds persistent volume integration tests - Updates fabric8io client to 4.1.1, in order to contain the latest k8s model. That translates to supporting k8s >= 1.9 model. Current version 4.1.0 supports only up to 1.9. Tests require volumeNodeAffinity as described in here: https://github.com/fabric8io/kubernetes- client/issues/1234. Given that Spark 3.0.0 will be out in several months from now, it seems a reasonable update. - Adds a custom tag to the test to exclude if run against a cloud backend. - Assumes default fs type for the host, AFAIK that is ext4. ## How was this patch tested? Manually run the tests against minikube as usual.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
