Hello all,

I would like to discuss the new Airflow Improvement Proposal which
aims to give Airflow users the possibility to trigger backfill
externally (via API or UI).

In short this AIP proposes:
- create new API endpoint to trigger backfill job (and same mechanism
for web ui)
- create new celery task to run backfill on worker machines (in case
of Celery-like executors)
- extend scheduler mechanism of removing zombies to take care of
backfill-triggered tasks and dagruns
- improve UI so users can see difference between scheduled and backfilled runs

I drafted a doc with the proposal:  https://s.apache.org/backfill-aip
so we can discuss it there before moving it to cwiki.

Happy to hear your opinion on this. And have a peaceful and warm holidays!

Best,
Tomek

Reply via email to