This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 952a004a6bb Bump Pyspark to even higher version (#50308)
952a004a6bb is described below
commit 952a004a6bb2c68d8d2743a3d96b5ce184889dd7
Author: Jarek Potiuk <[email protected]>
AuthorDate: Wed May 7 18:32:52 2025 +0200
Bump Pyspark to even higher version (#50308)
That should decrease the frequency of getting "download" errors
when downloading older versions of Spark
---
providers/apache/spark/pyproject.toml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/providers/apache/spark/pyproject.toml
b/providers/apache/spark/pyproject.toml
index 59f86567ff8..28d03c1abf2 100644
--- a/providers/apache/spark/pyproject.toml
+++ b/providers/apache/spark/pyproject.toml
@@ -59,7 +59,7 @@ requires-python = "~=3.9"
dependencies = [
"apache-airflow>=2.10.0",
"apache-airflow-providers-common-compat>=1.5.0",
- "pyspark>=3.4.0",
+ "pyspark>=3.5.2",
"grpcio-status>=1.59.0",
]
