sunchao commented on issue #41869: URL: https://github.com/apache/airflow/issues/41869#issuecomment-2321739560
Thanks @jscheffl ! The `.airflowignore` seems very useful in our case, will try it out. We are also thinking about switching to the standalone DAG processor which should help to further improve scheduler stability. I checked the 2.10 / master but it seems the relevant code paths remain pretty much the same. So I think the specific issue would still happen if we were on a higher version of Airflow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
