potiuk commented on PR #25161: URL: https://github.com/apache/airflow/pull/25161#issuecomment-1198448143
> General point: lets mark anything we do here as experimental as Dag Fetcher (AIP-5) may give us a nicer way of doing this We did already: > There is an experimental approach that you can take to optimize this behaviour. Note that it is not always possible to use (for example when generation of subsequent DAGs depends on the previous DAGs) or when there are some side-effects of your DAGs generation. Also the code snippet below is pretty complex and while we tested it and it works in most circumstances, there might be cases where detection of the currently parsed DAG will fail and it will revert to creating all the DAGs or fail. Use this solution with care and test it thoroughly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
