jroachgolf84 opened a new pull request, #63082: URL: https://github.com/apache/airflow/pull/63082
## Description Per #37213: > There seems to be substantial discrepancies between transfer operators, especially those using S3 as a source or destination. For example, in the `S3ToSFTPOperator`, only a single file can be transferred from the SFTP to the S3 bucket. However, in the `FTPToS3Operator` an arbitrary number of files can be transferred from S3 to an FTP site. To add to this, the `S3ToFTPOperator` only supports a single file being transferred. The PR refactors the `FTPToS3Operator` to mirror the functionality of the `S3ToFTPOperator` (it's "inverse" counterpart) and `SFTPToS3Operator` (it's sibling). This meant removing the ability to move multiple files and sticking with a single-file approach. This matches the behavior of its close relatives and helps to maintain Airflow DAG-authoring best practices. ## Testing These changes were tested E2E, as well as with updated unit tests. These unit tests can be run as follows: ```bash git fetch git checkout origin/issue-37213 git pull breeze testing providers-tests providers/amazon/tests/unit/amazon/aws/transfers/test_ftp_to_s3.py ``` closes: #37213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
