The GitHub Actions job "Check newsfragment PR number" on 
airflow.git/durable-livy has succeeded.
Run started by GitHub user 1fanwang (triggered by 1fanwang).

Head commit for run:
f52af3df16ec82dcd2daef5c06ddf23afece8abf / 1fanwang <[email protected]>
Reconnect to the running Livy batch on retry instead of resubmitting

When LivyOperator waits synchronously (deferrable=False with polling_interval > 
0) and the
worker is lost mid-poll, the retry currently posts a brand-new Livy batch, 
leaving the original
Spark application running and duplicating the work. Subclass ResumableJobMixin 
so the batch id is
persisted before polling and the retry reconnects to the in-flight batch. 
Deferrable and
fire-and-forget (polling_interval=0) paths are unchanged.

Report URL: https://github.com/apache/airflow/actions/runs/28129654948

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to