Hi everyone!

Yesterday we released airflow-declarative project which allows you
define DAGs declaratively via YAML.

https://github.com/rambler-digital-solutions/airflow-declarative

TL;DR

- Declarative DAGs in plain text YAML helps a lot to understand how
DAG will looks like. Made for humans, not programmers.
- It makes extremely hard to turn your DAGs into code mess. Even if
you make complicated YAMLs generator the result would be readable for
humans.
- No more guilty about coupling business logic with task management
system (Airflow). They now could coexists separated.
- Static analysis becomes a trivial task.
- It's a good abstraction to create your own scheduler/worker
compatible with original Airflow one.

You can check for examples here:
https://github.com/rambler-digital-solutions/airflow-declarative/tree/master/tests/dags/good

Any feedback is welcome!

--
,,,^..^,,,

Reply via email to