[
https://issues.apache.org/jira/browse/AIRFLOW-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16214462#comment-16214462
]
Nick Bauer commented on AIRFLOW-1641:
-------------------------------------
I'll try to make some time to test this, but I just recently upgraded our code
so our dags load faster. it should be pretty easy to test however: Create a
dag that takes a long time to load - like have it sleep. , and set your dagbag
import to something small like 5 seconds.
> Task gets stuck in queued state
> -------------------------------
>
> Key: AIRFLOW-1641
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1641
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Affects Versions: 1.8.0
> Environment: Linux
> Reporter: Mas
> Assignee: Bolke de Bruin
> Labels: queued, scheduler, stuck, task
> Fix For: 1.9.0
>
>
> Hello,
> I have one dag with ~20 tasks.
> The dags runs daily and some tasks can sometime last for hours, depending on
> the processed data behind.
> There are some interactions with AWS and a remote DB.
> I only use LocalExecutor.
> What this issue is about, is the fact that sometime (randomly, and without
> any clear reason) one of the tasks (here also, it is random) gets stuck in
> "queued" state and never starts running.
> The manual workaround is to restart the task manually by clearing it.
> Does anyone have ideas about the issue behind, and how to avoid it for the
> future?
> Thanks in advance for your help.
> PS: other people are facing the same behaviour:
> [link|https://stackoverflow.com/questions/45853013/airflow-tasks-get-stuck-at-queued-status-and-never-gets-running]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
