GitHub user tanelk added a comment to the discussion: DAG Parsing Performance with Large Number of Dynamically Generated DAGs
Perhaps this is helpfull: https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html#optimizing-dag-parsing-delays-during-execution It will not break the "main" dag parsing loop into pieces, but reduces the load when executing. GitHub link: https://github.com/apache/airflow/discussions/44727#discussioncomment-11665001 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
