(airflow) branch main updated: Better log when spark k8s driver remains in Unknown Phase (#70176)

[shahar]

This is an automated email from the ASF dual-hosted git repository.

shahar1 pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 523a803e906 Better log when spark k8s driver remains in Unknown Phase 
(#70176)
523a803e906 is described below

commit 523a803e90610db2cd497188f0210a3185370558
Author: Amogh Desai <amoghrajesh1...@gmail.com>
AuthorDate: Wed Jul 22 11:43:27 2026 +0530

    Better log when spark k8s driver remains in Unknown Phase (#70176)
---
 .../spark/src/airflow/providers/apache/spark/hooks/spark_submit.py    | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git 
a/providers/apache/spark/src/airflow/providers/apache/spark/hooks/spark_submit.py
 
b/providers/apache/spark/src/airflow/providers/apache/spark/hooks/spark_submit.py
index 662966e4e14..6d90f7b003b 100644
--- 
a/providers/apache/spark/src/airflow/providers/apache/spark/hooks/spark_submit.py
+++ 
b/providers/apache/spark/src/airflow/providers/apache/spark/hooks/spark_submit.py
@@ -1237,7 +1237,9 @@ class SparkSubmitHook(BaseHook, LoggingMixin):
                     if consecutive_unknown >= max_consecutive_unknown:
                         raise RuntimeError(
                             f"Spark application {app_id} reported Unknown 
phase "
-                            f"{consecutive_unknown} times consecutively; 
giving up."
+                            f"{consecutive_unknown} times consecutively (the 
pod's state could not "
+                            f"be obtained, typically due to an error 
communicating with the node the "
+                            f"pod should be running on); giving up."
                         )
                 else:
                     consecutive_unknown = 0