hankehly opened a new pull request, #32760: URL: https://github.com/apache/airflow/pull/32760
related: #31137, #32296 ## Summary This PR adds an optional `user_project` argument to `GCSToS3Operator` in order to support operations on Google Cloud Storage buckets that have the [Requester Pays](https://cloud.google.com/storage/docs/requester-pays) feature enabled. Classes and methods affected: - GCSToS3Operator - GCSDeleteBucketOperator (change required for system test) - GCSHook.download - GCSHook.provide_file - GCSHook.provide_file_and_upload - GCSHook.upload - GCSHook.delete_bucket (change required for system test) - GCSHook.list ## Testing All affected classes and methods are covered in the below system test. ```sh export AWS_ACCESS_KEY_ID= export AWS_SECRET_ACCESS_KEY= export AWS_DEFAULT_REGION= export GOOGLE_APPLICATION_CREDENTIALS= export GCP_PROJECT_ID= pytest --system amazon tests/system/providers/amazon/aws/example_gcs_to_s3.py ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
