Very nice! This could indirectly be used to create DAG DSLs in languages other than Python. But perhaps there already is a way for someone to tap into the DAG model and program it in, say, Ruby or Scala or Perl...
On Fri, Jul 28, 2017 at 8:21 PM, Alexander Shorin <kxe...@gmail.com> wrote: > Hi everyone! > > Yesterday we released airflow-declarative project which allows you > define DAGs declaratively via YAML. > > https://github.com/rambler-digital-solutions/airflow-declarative > > TL;DR > > - Declarative DAGs in plain text YAML helps a lot to understand how > DAG will looks like. Made for humans, not programmers. > - It makes extremely hard to turn your DAGs into code mess. Even if > you make complicated YAMLs generator the result would be readable for > humans. > - No more guilty about coupling business logic with task management > system (Airflow). They now could coexists separated. > - Static analysis becomes a trivial task. > - It's a good abstraction to create your own scheduler/worker > compatible with original Airflow one. > > You can check for examples here: > https://github.com/rambler-digital-solutions/airflow- > declarative/tree/master/tests/dags/good > > Any feedback is welcome! > > -- > ,,,^..^,,, > -- Stefano Baghino | TERALYTICS *software engineer* Teralytics AG | Zollstrasse 62 | 8005 Zurich | Switzerland phone: +41 43 508 24 57 email: stefano.bagh...@teralytics.ch www.teralytics.net Company registration number: CH-020.3.037.709-7 | Trade register Canton Zurich Board of directors: Georg Polzer, Luciano Franceschina, Mark Schmitz, Yann de Vries This e-mail message contains confidential information which is for the sole attention and use of the intended recipient. Please notify us at once if you think that it may not be intended for you and delete it immediately.
