Gelerion commented on issue #13542: URL: https://github.com/apache/airflow/issues/13542#issuecomment-1140498051
@mattvonrocketstein I can confirm the issue is still present with autoscaling disabled. In our case, we dynamically create dags, so the MWAA team's first suggestion was to reduce the load on the scheduler by increasing the refresh dags interval. It seems to help. We see fewer errors in the logs, and tasks getting stuck less often, but it didn't resolve the issue. Now we are waiting for the second round of suggestions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
