feng-tao commented on issue #4673: [AIRFLOW-3851] ExternalTasksensor not check 
existence in later poke
URL: https://github.com/apache/airflow/pull/4673#issuecomment-462011507
 
 
   @XD-DENG , I don't think I agree.  ExternalTaskSensor will do a poke every 1 
sec for 1 day. If we have about 1k-2k(which is very normal in our production) 
externalTaskSensor, you could do the math on how many times it loads the Dag 
Bag which is useless. And we have seen many transient DAG parsing failure 
because of this change. 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to