[
https://issues.apache.org/jira/browse/AIRFLOW-2027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16431074#comment-16431074
]
ASF subversion and git services commented on AIRFLOW-2027:
----------------------------------------------------------
Commit 44ce9ca71beb5b0aca1b21cb8c6e9420ce89639f in incubator-airflow's branch
refs/heads/master from [~sekikn]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=44ce9ca ]
[AIRFLOW-2305][AIRFLOW-2027] Fix CI failure caused by []
Closes #3205 from sekikn/AIRFLOW-2305
> Only trigger sleep in scheduler after all files have parsed
> -----------------------------------------------------------
>
> Key: AIRFLOW-2027
> URL: https://issues.apache.org/jira/browse/AIRFLOW-2027
> Project: Apache Airflow
> Issue Type: Improvement
> Components: scheduler
> Reporter: Dan Davydov
> Assignee: Dan Davydov
> Priority: Major
> Fix For: 1.10.0
>
>
> The scheduler loop sleeps for 1 second every loop unnecessarily. Remove this
> sleep to slightly speed up scheduling, and instead do it once all files have
> been parsed. It can add up since it runs to every scheduler loop which runs #
> of dags to parse/scheduler parallelism times.
> Also remove the unnecessary increased file processing interval in tests which
> slows them down.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
