Andre created AIRFLOW-173:
-----------------------------

             Summary: Create a FileSensor / NFSFileSensor sensor
                 Key: AIRFLOW-173
                 URL: https://issues.apache.org/jira/browse/AIRFLOW-173
             Project: Apache Airflow
          Issue Type: Improvement
            Reporter: Andre
            Priority: Minor


While HDFS and WebHDFS suit most organisations using Hadoop, for some shops 
running MapR-FS, Airflow implementation is simplified by the use of plain files 
pointing to MapR's NFS gateways.

A FileSensor and/or a NFSFileSensor would assist the adoption of Airflow within 
the MapR customer base, but more importantly, help those who are using POSIX 
compliant distributed filesystems that can be mounted on Unix derivative 
systems (e.g. as MapR-FS (via NFS), CephFS, GlusterFS, etc).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to