Hi airflow experts,
I am very confused on the usage of ExternalTaskSensor, I need to trigger a
dag(running hourly) remotely from another dag(running only once), here is my
environment(attached the dag file as well).
1st, Configure example_base_operator.py, set it running only once.
2nd, Configure example_external_sensor.py, set it running hourly and use
external task sensor to Poke the execution status of
example_bash_operator.run_this_last(I want the task to be triggered right after
the completion of the example_bash_operator.run_this_last)
app_workload_sensor = ExternalTaskSensor(
task_id='app_workload_sensor',
external_dag_id='example_bash_operator',
external_task_id='run_this_last',
execution_date_fn=lambda dt: dt + timedelta(0),
dag=dag)
3rd, Start the example_external_sersor and then start example_base_operator.py
4th, example_base_operator completed instantly.
5th, but the app_workload_sersor continue Poking on the
example_bash_operator.run_this_last but never kick out the following jobs.
Can anybody help to check if there is anything wrong in configuration, why the
tasks never complete.
Thanks and best regards
Larry Wang
