This is an automated email from the ASF dual-hosted git repository.
pbacsko pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/yunikorn-k8shim.git
The following commit(s) were added to refs/heads/master by this push:
new c5a82acc [YUNIKORN-2170] Update Spark version to 3.3.3 (#731)
c5a82acc is described below
commit c5a82accee6bbef68859832948dd944df3034daa
Author: Peter Bacsko <[email protected]>
AuthorDate: Wed Nov 22 15:38:40 2023 +0100
[YUNIKORN-2170] Update Spark version to 3.3.3 (#731)
Spark 3.3.1 has been archived and downloading is slow from
archive.apache.org.
Closes: #731
Signed-off-by: Peter Bacsko <[email protected]>
---
Makefile | 6 ++++--
1 file changed, 4 insertions(+), 2 deletions(-)
diff --git a/Makefile b/Makefile
index 78245d3c..4a642a52 100644
--- a/Makefile
+++ b/Makefile
@@ -130,10 +130,12 @@
HELM_ARCHIVE=helm-$(HELM_VERSION)-$(OS)-$(EXEC_ARCH).tar.gz
HELM_ARCHIVE_BASE=$(OS)-$(EXEC_ARCH)
# spark
-export SPARK_VERSION=3.3.1
+export SPARK_VERSION=3.3.3
+# sometimes the image is not avaiable with $SPARK_VERSION, the minor version
must match
+export SPARK_PYTHON_VERSION=3.3.1
export SPARK_HOME=$(BASE_DIR)$(TOOLS_DIR)/spark
export SPARK_SUBMIT_CMD=$(SPARK_HOME)/bin/spark-submit
-export SPARK_PYTHON_IMAGE=docker.io/apache/spark-py:v$(SPARK_VERSION)
+export SPARK_PYTHON_IMAGE=docker.io/apache/spark-py:v$(SPARK_PYTHON_VERSION)
FLAG_PREFIX=github.com/apache/yunikorn-k8shim/pkg/conf
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
