bobo333 edited a comment on issue #13637: URL: https://github.com/apache/airflow/issues/13637#issuecomment-831001974
hi, we (@yuzeh and I) are also seeing this behavior on airflow `2.0.2` using `LocalExecutor`. With `min_file_process_interval = 60` and `parsing_processes = 2` cpu usage for the scheduler is very similar to what @linxiaohui posted, both processes are using 90% or higher cpu, often up to 150%. There are no active workloads running during this time either, those only run on the hour, but this behavior happens constantly. Note: this was _not_ happening before we upgraded to airflow 2. On `1.10.14` we did not see this level of cpu usage from the scheduler. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
