Taragolis commented on PR #36179: URL: https://github.com/apache/airflow/pull/36179#issuecomment-1851720940
> Currently, credentials are loaded once at the initialization of the ECS Executor, and those credentials are used to authenticate to the ECS API. If those credentials expire, the Executor will not able to schedule new tasks, or update existing ones. Maybe it is some bug in refresh credentials into the [BaseSessionFactory](https://github.com/apache/airflow/blob/47a9c8a4a4ecc4da34bd210d56331e97f9fe8e7e/airflow/providers/amazon/aws/hooks/base_aws.py#L73) or either into the `botocore` / `boto3`? I've asked it because refresh credentials it is internals of the Credential Providers into the `botocore`, that part not well documented as well as not well implemented into the AWS Provider, to be honest the solution which works now seems to be copy-pasted from the SO https://github.com/apache/airflow/blob/5f4d2b5dee2e98a05124865c6fa855bc26d0af26/airflow/providers/amazon/aws/hooks/base_aws.py#L238-L241 However if it failed into the ECS Executor then seems like it should failed also in regular usage -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
