feng-tao edited a comment on issue #4673: [AIRFLOW-3851] ExternalTasksensor not 
check existence in later poke
URL: https://github.com/apache/airflow/pull/4673#issuecomment-461891331
 
 
   @ashb , it only loads the DagBag with the DAG file location, hence we only 
load one DAG. The use case here is to solve(XD correct me if I am worng) the 
case when user uses ExternalTaskSensor to check dependency while that 
dependency get modified. The sensor will not fail until 1day(need to check the 
default?) . Hence we would like to fail fast if that's the case. The logic here 
is:
   1. check whether that DAG exists or not in DB DAG table.
   2. check whether the DAG file exists or not in disk
   3. check whether the task which the sensor is currently waiting for still 
exists or not in the DAG.
   
   Hence we need to load the actual DAG file to verify instead of checking the 
DB.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to