This would only work if the same connection ID has access to both buckets - and 
will make AWS do the copy (so we don't have to download and re-upload the file)

To support copying across roles/connections we could use something like 
https://pypi.org/project/smartopen/ to stream down and up (I have some code 
that does this if we want, but I think that is a different PR)

[ Full content available at: 
https://github.com/apache/incubator-airflow/pull/3823 ]
This message was relayed via gitbox.apache.org for [email protected]

Reply via email to