Draqun commented on PR #29156: URL: https://github.com/apache/airflow/pull/29156#issuecomment-1404652289
The scenario is as follows: - a container is started using DockerOperator, where data is prepared for processing in the cloud (AWS and AZURE) - data after processing in the cloud is saved in S3/Azure Storage as a rather large file - this file needs to be uploaded to the FTP server - instead of downloading the file, I want to use smart_open and pass the file handle as a parameter to the FTP provider. The proposed fix solves my problem. Everything works as expected because FTPHook is customised for this type of operation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
