[ 
https://issues.apache.org/jira/browse/AIRFLOW-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300728#comment-15300728
 ] 

Bolke de Bruin commented on AIRFLOW-173:
----------------------------------------

I like it, but wouldnt a inotify combination with a trigger dag_run not be more 
efficient?

> Create a FileSensor / NFSFileSensor sensor
> ------------------------------------------
>
>                 Key: AIRFLOW-173
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-173
>             Project: Apache Airflow
>          Issue Type: Improvement
>            Reporter: Andre
>            Priority: Minor
>
> While HDFS and WebHDFS suit most organisations using Hadoop, for some shops 
> running MapR-FS, Airflow implementation is simplified by the use of plain 
> files pointing to MapR's NFS gateways.
> A FileSensor and/or a NFSFileSensor would assist the adoption of Airflow 
> within the MapR customer base, but more importantly, help those who are using 
> POSIX compliant distributed filesystems that can be mounted on Unix 
> derivative systems (e.g. as MapR-FS (via NFS), CephFS, GlusterFS, etc).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to