Marcus Rehm created AIRFLOW-2420:
------------------------------------
Summary: Add functionality for Azure Data Lake
Key: AIRFLOW-2420
URL: https://issues.apache.org/jira/browse/AIRFLOW-2420
Project: Apache Airflow
Issue Type: New Feature
Components: hooks
Reporter: Marcus Rehm
Assignee: Marcus Rehm
Currently Airflow has a hook for Azure Blob Storage but it does not support
Azure Data Lake.
As a first step a hook would interface with Azure Data Lake via the Python SDK
over the adl protocol.
The hook would have a simple interface to upload and download files with all
parameters available in ADL sdk and also a check for file to query if a file
exists in the data lake. This last functions will enable sensors development in
the future.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)