rlebreto commented on issue #46334: URL: https://github.com/apache/airflow/issues/46334#issuecomment-2788755890
Hi @kgw7401 Thanks a lot for your help. To not be blocked, I forced the value returned by **_resolve_should_track_driver_status** from **/usr/local/lib/python3.12/site-packages/airflow/providers/apache/spark/hooks/spark_submit.py** to False I'm not completely sure of the impact of the problem. I'm suspecting that airflow will not be able to get back the status from the driver if the connection with it is lost. I hope that running my sparkSubmit job with verbose='true' + retries=0 will allow me to track an error if the job fails, but I'm not very confident with that :-) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
