john-jac opened a new pull request #18156: URL: https://github.com/apache/airflow/pull/18156
Add role_arn to S3ToRedshiftTransfer and RedshiftToS3Transfer These changes check the S3Hook connection for a role_arn and, if found, use that as the credentials for the S3 LOAD and UNLOAD operations. If role_arn is not present, the previous method using boto3.Session is maintained. Tests have been added for both operators, based upon the existing tests. Note that when using IAM roles, S3Hook is not instantiated as there is no need for the boto3 session object. This means that the IAM principle executing the operator does need to be able to assume the IAM role in the connection as that is not required by Redshift. See https://docs.aws.amazon.com/redshift/latest/dg/copy-parameters-authorization.html#copy-credentials for more details. closes: #9971 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
