Some additional info:
One of the DAG definitions:
dag = DAG(
dag_id='sync_payments',
default_args={
'owner': 'joe',
'email': [...],
'email_on_failure': True,
'email_on_retry': False,
'depends_on_past': False,
'start_date': datetime(2017, 4, 25, 0, 0, 0),
'sla': timedelta(minutes=20),
'retries': 10,
'retry_delay': timedelta(minutes=1),
},
schedule_interval=timedelta(minutes=10),
)
A log-screenshot example. There was supposed to be a whole schedule interval
run at 19:10, but just didn't. This was back when I was still using
LocalExecutor, but its pretty much the same with Celery now, just less often
and rarely/never the whole interval, just a few tasks.
https://pasteboard.co/eUexoUcew.png
And here is an ilustration of how it can look in Airflow web UI:
https://pasteboard.co/eTMtJKr0w.png
