huozhanfeng opened a new issue #17437: URL: https://github.com/apache/airflow/issues/17437
<!-- Welcome to Apache Airflow! For a smooth issue process, try to answer the following questions. Don't worry if they're not all applicable; just try to include what you can :-) If you need to include code snippets or logs, please put them in fenced code blocks. If they're super-long, please use the details tag like <details><summary>super-long log</summary> lots of stuff </details> Please delete these comment blocks before submitting the issue. --> **Description** In our production env, there are 5000+ dag files. It will delay for almost 10mins to recognize the new dag file if a new one comes. There are 16 CPU cores in the scheduler machine. The airflow version is 2.1.0. <!-- A short description of your feature --> **Use case / motivation** I think there should be a feature to support recognize new dag files or recently modified dag files faster. <!-- What do you want to happen? Rather than telling us how you might implement this solution, try to take a step back and describe what you are trying to achieve. --> **Are you willing to submit a PR?** Maybe will. <!--- We accept contributions! --> **Related Issues** <!-- Is there currently another issue associated with this? --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
