[GitHub] [airflow] ecerulm commented on issue #14598: Provide shared storage between task via pluggable storage providers (akin to S3 remote logging)

2021-03-04 Thread GitBox
ecerulm commented on issue #14598: URL: https://github.com/apache/airflow/issues/14598#issuecomment-790965006 I must confess that I didn't know about [Airflow 2.0: DAG Authoring Redesigned](https://medium.com/apache-airflow/airflow-2-0-dag-authoring-redesigned-651edc397178) and that it

[GitHub] [airflow] ecerulm commented on issue #14598: Provide shared storage between task via pluggable storage providers (akin to S3 remote logging)

2021-03-04 Thread GitBox
ecerulm commented on issue #14598: URL: https://github.com/apache/airflow/issues/14598#issuecomment-790584181 My idea was to implement with with a pluggable storage so that S3, and other storage can be used. My initial idea on how this could work is the following: * When the task