Ravali-43 opened a new issue, #39737:
URL: https://github.com/apache/airflow/issues/39737

   ### Apache Airflow Provider(s)
   
   amazon
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Apache Airflow version
   
   2.6.3
   
   ### Operating System
   
   red hat linux 8.9
   
   ### Deployment
   
   Google Cloud Composer
   
   ### Deployment details
   
   _No response_
   
   ### What happened
   
   trouble using GCStoS3 operator. while trying to copy the files from gs 
location to S3 bucket, instead of copying *.txt file from a folder, the current 
code is appending gcs file path to s3 location. Meaning resulting in having the 
entire file path in s3 destination as well. ex: parentfolder/childfolder/*.txt 
--> the same is copied into S3 as well.. 
s3://bucket/parentfolder/childfolder/*.txt instead s3://bucket/*.txt.
   PS: in dag config i have set the keep_directory_structure to false. observed 
the same issue
   
   ### What you think should happen instead
   
   _No response_
   
   ### How to reproduce
   
   Please change the congif/code where only files are being copied to 
destination location
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to