pbhuss opened a new issue, #32920:
URL: https://github.com/apache/airflow/issues/32920

   ### Apache Airflow version
   
   2.6.3
   
   ### What happened
   
   
https://github.com/apache/airflow/blob/d800c1bc3967265280116a05d1855a4da0e1ba10/airflow/providers/amazon/aws/transfers/gcs_to_s3.py#L148-L150
   
   This line in `GCSToS3Operator` is currently broken on Airflow 2.6.3:
   ```
   Traceback (most recent call last):
     File 
"/usr/local/lib/python3.10/site-packages/airflow/providers/amazon/aws/transfers/gcs_to_s3.py",
 line 148, in execute
       files = hook.list(
   TypeError: GCSHook.list() got an unexpected keyword argument 'match_glob'
   ```
   
   The call signature for `GCSHook.list` does not have a `match_glob` argument 
on Airflow 2.6.3
   
https://github.com/apache/airflow/blob/eb24742d5300d2d87b17b4bcd67f639dbafd9818/airflow/providers/google/cloud/hooks/gcs.py#L699
   
   However it does on the `main` branch:
   
https://github.com/apache/airflow/blob/0924389a877c5461733ef8a048e860b951d81a56/airflow/providers/google/cloud/hooks/gcs.py#L702-L710
   
   It appears that `GCSToS3Operator` jumped the gun on using the `match_glob` 
   
   
   ### What you think should happen instead
   
   _No response_
   
   ### How to reproduce
   
   Create a task that uses 
`airflow.providers.amazon.aws.transfers.gcs_to_s3.GCSToS3Operator`. Execute the 
task.
   
   ### Operating System
   
   Debian GNU/Linux 11 (bullseye)
   
   ### Versions of Apache Airflow Providers
   
   apache-airflow-providers-amazon==8.3.1
   apache-airflow-providers-celery==3.2.1
   apache-airflow-providers-cncf-kubernetes==7.3.0
   apache-airflow-providers-common-sql==1.6.0
   apache-airflow-providers-datadog==3.3.1
   apache-airflow-providers-dbt-cloud==3.2.2
   apache-airflow-providers-elasticsearch==4.5.1
   apache-airflow-providers-ftp==3.4.2
   apache-airflow-providers-google==10.0.0
   apache-airflow-providers-http==4.5.0
   apache-airflow-providers-imap==3.2.2
   apache-airflow-providers-microsoft-azure==6.2.1
   apache-airflow-providers-postgres==5.5.2
   apache-airflow-providers-redis==3.2.1
   apache-airflow-providers-sftp==4.4.0
   apache-airflow-providers-slack==7.3.1
   apache-airflow-providers-sqlite==3.4.2
   apache-airflow-providers-ssh==3.7.1
   
   ### Deployment
   
   Astronomer
   
   ### Deployment details
   
   Using Astro Runtime 8.8.0
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to