cruseakshay opened a new pull request, #62772:
URL: https://github.com/apache/airflow/pull/62772
Add `deferrable=True` support to `AzureContainerInstancesOperator` so
tasks release their worker slot while waiting for long-running containers,
offloading polling to the lightweight Triggerer process.
## Changes
- **New `AzureContainerInstanceAsyncHook`** — async counterpart to the
existing sync hook, using `azure.mgmt.containerinstance.aio` for
non-blocking state/log/delete calls.
- **New `AzureContainerInstanceTrigger`** — polls ACI at a configurable
interval and yields a `TriggerEvent` when the container reaches a
terminal state.
- **`AzureContainerInstancesOperator`** — three new parameters:
- `deferrable` (default from `conf`) — enables deferrable mode
- `polling_interval` (default `5.0s`) — trigger poll frequency
- `remove_on_success` (default `True`) — controls cleanup on success
- Also fixes a bug where the `finally` cleanup block would delete a
still-running container group immediately after `self.defer()` raised
`TaskDeferred`.
- **`provider.yaml` + `get_provider_info.py`** updated to register the
new trigger.
closes: #62433
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes — Cursor, following [the
guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
