mikoloay commented on issue #58995:
URL: https://github.com/apache/airflow/issues/58995#issuecomment-3612335038

   **Update**: after more debugging I discovered that the error actually 
appears as expected when the dagbag import timeout occurs. It's when the 
dag_file_processor_timeout has a smaller value than the dagbag_import_timeout, 
that the timeout is silent.
   
   The thing is - my dag_file_processor_timeout is set to a different value in 
the airflow.cfg file - it's set to 150 seconds and the dagbag_import_timeout is 
set to 120 seconds. Yet it seems that the dag_file_processor_timeout property 
was ignored and the default 50 seconds were used.
   
   Here's the output of the "airflow config list | grep 
dag_file_processor_timeout" command:
   dag_file_processor_timeout = 150
   dag_file_processor_timeout = 50
   
   After this discovery I've set the timeout using the environment variable and 
now the output of the same command looks like this:
   dag_file_processor_timeout = 150
   dag_file_processor_timeout = 600
   
   After using the env var, dag bag import timeouts occur before dag file 
processor timeouts and I can see import timeout errors in the UI, so this bug 
is probably related to parsing configuration.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to