[
https://issues.apache.org/jira/browse/SPARK-26742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787145#comment-16787145
]
Jiaxin Shan commented on SPARK-26742:
-------------------------------------
Double confirm master PR change pass integration test on kubernetes version
* v1.10.13
* v1.11.7
* v1.12.6
* v1.13.3
{code:java}
Tests: succeeded 15, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 4.647 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 3.894 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 2.867 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 5.506 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 3.178 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 3.026 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 3.903 s]
[INFO] Spark Project Core ................................. SUCCESS [ 32.987 s]
[INFO] Spark Project Kubernetes Integration Tests ......... SUCCESS [08:28 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 09:28 min
[INFO] Finished at: 2019-03-07T10:51:01-08:00
[INFO] ------------------------------------------------------------------------
➜ integration-tests git:(update_k8s_sdk_master) ✗ minikube start --cpus 4
--memory 6000 --kubernetes-version=v1.10.13
Tests: succeeded 15, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 4.852 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 4.028 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 2.872 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 5.205 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 3.200 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 3.681 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 3.734 s]
[INFO] Spark Project Core ................................. SUCCESS [ 31.357 s]
[INFO] Spark Project Kubernetes Integration Tests ......... SUCCESS [08:02 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 09:01 min
[INFO] Finished at: 2019-03-07T11:11:39-08:00
[INFO] ------------------------------------------------------------------------
➜ integration-tests git:(update_k8s_sdk_master) ✗ minikube start --cpus 4
--memory 6000 --kubernetes-version=v1.11.7
All tests passed.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 4.512 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 3.632 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 3.182 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 4.543 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 2.444 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 2.777 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 3.773 s]
[INFO] Spark Project Core ................................. SUCCESS [ 29.389 s]
[INFO] Spark Project Kubernetes Integration Tests ......... SUCCESS [08:38 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 09:33 min
[INFO] Finished at: 2019-03-07T11:47:33-08:00
[INFO] ------------------------------------------------------------------------
➜ integration-tests git:(update_k8s_sdk_master) ✗ minikube start --cpus 4
--memory 6000 --kubernetes-version=v1.12.6
Tests: succeeded 15, failed 0, canceled 0, ignored 0, pending 0
All tests passed.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.0.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 5.327 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 4.828 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 3.686 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 5.383 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 2.749 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 3.048 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 5.052 s]
[INFO] Spark Project Core ................................. SUCCESS [ 36.159 s]
[INFO] Spark Project Kubernetes Integration Tests ......... SUCCESS [07:52 min]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 08:59 min
[INFO] Finished at: 2019-03-07T11:27:12-08:00
[INFO] ------------------------------------------------------------------------
➜ integration-tests git:(update_k8s_sdk_master) ✗ minikube start --cpus 4
--memory 6000 --kubernetes-version=v1.13.3
{code}
> Bump Kubernetes Client Version to 4.1.2
> ---------------------------------------
>
> Key: SPARK-26742
> URL: https://issues.apache.org/jira/browse/SPARK-26742
> Project: Spark
> Issue Type: Dependency upgrade
> Components: Kubernetes
> Affects Versions: 2.4.0, 3.0.0
> Reporter: Steve Davids
> Priority: Major
> Labels: easyfix
> Fix For: 3.0.0
>
>
> Spark 2.x is using Kubernetes Client 3.x which is pretty old, the master
> branch has 4.0, the client should be upgraded to 4.1.1 to have the broadest
> Kubernetes compatibility support for newer clusters:
> https://github.com/fabric8io/kubernetes-client#compatibility-matrix
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
