skestle commented on PR #38916:
URL: https://github.com/apache/airflow/pull/38916#issuecomment-2700006625
I came across this, trying to figure out why the livy trigger had it's own
timeout mechanism.
I understand that the error in the bug can be caused by un-initialised
`_batch_id`, but I can't figure out how it would become uninitialised while
using the deferred trigger.
```
def execute(self, context: Context) -> Any:
self._batch_id = self.hook.post_batch(**self.spark_params)
```
initialised the batch id, which is passed to the trigger - why was batch id
not still set when `on_kill` is called later (after general airflow timeout)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
