Hello I am working with Airflow to see how we can use it in my company, and I volunteer to help you if you need help on some parts. I used to work a lot with Python and Twisted, but real, distributed scheduling is kind of a new sport for me.
I see that deploying DAGs regularly is not as easy as we can imagine. I started playing with git-sync and apparently it is not recommended in prod since it can lead to an incoherent state if the scheduler is refreshed in the middle of the execution. But DAGs lives and they can be updated by users and I think Airflow needs a way to allow automatic refresh of the DAGs without having to stop the scheduler. Does anyone already works on it, or do you have a set of JIRA ticket covering this issue so I can start working on it ? Best Regards, Gaetan Semet
