Programmer-RD-AI opened a new pull request, #53454: URL: https://github.com/apache/airflow/pull/53454
This PR addresses [Issue #53359](https://github.com/apache/airflow/issues/53359) by introducing a shared, class-level asynchronous client in `AwsBaseWaiterTrigger`. This change prevents event loop blocking during trigger initialization caused by `aiobotocore` session startup and AWS service loading (see also: [aio-libs/aiobotocore#1023](https://github.com/aio-libs/aiobotocore/issues/1023). ### What Changed: * Added `_shared_client` at the class level to reuse the `aiobotocore` connection across triggers. * Ensured that `hook.get_async_conn()` is only awaited once, reducing repeated blocking I/O when triggers start. ### How to Reproduce the Fix: Run a deferrable AWS operator (like `AthenaOperator`) under load and observe that the "triggerer's async thread was blocked" warnings are eliminated or significantly reduced. ### Notes: * This is a non-breaking, internal improvement targeting performance and stability of deferrable AWS operators. * Does not affect backward compatibility or existing behavior. * Long-term, this could be extended into a more general connection pool strategy if similar issues arise in other async triggers. ### Related: * closes: #53359 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
