ephraimbuddy opened a new pull request, #59247: URL: https://github.com/apache/airflow/pull/59247
Workers were unable to retrieve S3 connection credentials for remote logging even though the credentials were successfully fetched via the API. This caused task logs to fail uploading to S3 with errors like "Unable to find AWS Connection ID" and falling back to boto3 credential strategy. The root cause was that when _remote_logging_conn sets the connection environment variable, Connection deserialization was using the core Connection class instead of the SDK Connection class. The core Connection class doesn't have the from_uri() method needed for proper URI deserialization in the supervisor context. This fix sets _AIRFLOW_PROCESS_CONTEXT=client in the _remote_logging_conn context manager, ensuring that Connection deserialization uses the SDK Connection class which properly handles URI deserialization from environment variables. Fixes #58140 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
