potiuk commented on PR #29156: URL: https://github.com/apache/airflow/pull/29156#issuecomment-1436014426
I agree with @Taragolis - that passing file-like objects in FileTransferOperator is not going to work. Each operator when executing will run in its own process/interpreter and there is simply no way to pass the file-like object to it. Closing, unless there will be some explanation - maybe we are wrong and there is something we both completely miss. @Draqun - if you can explain it, please do. The way how you should do what you want is different - you could implement File-lilke objects in Hooks and then use TaskFlow approach as desrribed in my blog post here: https://medium.com/apache-airflow/generic-airflow-transfers-made-easy-5fe8e5e7d2c2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
