ferruzzi opened a new pull request, #28236: URL: https://github.com/apache/airflow/pull/28236
This PR cleans up a bit of tech debt in the EKS operators. When I wrote them I didn't know what boto waiters were. A Boto waiter is similar to an Ariflow Sensor but the delay, backoff, and max-retries is all handled server-side by the service. I've replaced a bunch of my custom waiter code with official boto waiters, added the infrastructure to allow us to write custom waiters, along with documentation and an example. This should make future AWS sensors much easier and cleaner to write. We may want to go through the existing sensors and convert them over at some point. This also opens up an interesting idea of using a custom waiter in a TaskFlow method in place of a sensor. Who knows. Rendered version of the README is [here](https://github.com/aws-mwaa/upstream-to-airflow/blob/a5ff1624eae1570ad9b885fdbc8ec4c1a3b65ea7/airflow/providers/amazon/aws/waiters/README.md) for easier review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
