ldacey commented on issue #11968: URL: https://github.com/apache/airflow/issues/11968#issuecomment-723524637
I am using these libraries for Dask and pyarrow (and it is an optional dependency for pandas too). It seems like the adlfs library has a lot of the common methods needed for a wasb_hook: https://github.com/dask/adlfs/blob/v0.5.0/adlfs/spec.py https://github.com/intake/filesystem_spec/tree/master/fsspec I am using a custom wasb_hook right now so I was planning on trying to upgrade to v12 to see what breaks. I am mostly worried about my remote logging (I have not looked into airflow logging at all). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
