Hi, We are building a web-based UI to author flows. A user will drag-n-drop tasks on a canvas and link them to define the dependency. In Airflow, these tasks are PythonOperators that invoke functions containing the business logic (written by us).
I was wondering what is the best way to submit the UI-generated DAG to Airflow. As a test, we generated Python code and saved it to a file in the DAGs directory. While that works, I don’t think it is the best solution. Is there an API to define the DAG? Could Jinja templating help? Any recommendations of how to do this elegantly will be appreciated. Arpan Dhandhania e: [email protected] m: +91 782 939 5618 — Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.
