[
https://issues.apache.org/jira/browse/AIRFLOW-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564311#comment-16564311
]
ASF GitHub Bot commented on AIRFLOW-1104:
-----------------------------------------
dan-sf commented on issue #3568: AIRFLOW-1104 Update jobs.py so Airflow does
not over schedule tasks
URL:
https://github.com/apache/incubator-airflow/pull/3568#issuecomment-409350564
@kaxil Conflicts have been updated
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Concurrency check in scheduler should count queued tasks as well as running
> ---------------------------------------------------------------------------
>
> Key: AIRFLOW-1104
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1104
> Project: Apache Airflow
> Issue Type: Bug
> Environment: see https://github.com/apache/incubator-airflow/pull/2221
> "Tasks with the QUEUED state should also be counted below, but for now we
> cannot count them. This is because there is no guarantee that queued tasks in
> failed dagruns will or will not eventually run and queued tasks that will
> never run will consume slots and can stall a DAG. Once we can guarantee that
> all queued tasks in failed dagruns will never run (e.g. make sure that all
> running/newly queued TIs have running dagruns), then we can include QUEUED
> tasks here, with the constraint that they are in running dagruns."
> Reporter: Alex Guziel
> Priority: Minor
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
