Kamil Szkoda updated AIRFLOW-2189:
    Summary: Scheduler under systemd doesn't work in parallel  (was: Scheduler 
under systemd doesn't work in parrarel)

> Scheduler under systemd doesn't work in parallel
> ------------------------------------------------
>                 Key: AIRFLOW-2189
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-2189
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: scheduler
>    Affects Versions: 1.9.0
>            Reporter: Kamil Szkoda
>            Priority: Major
> I'm using scheduler under system V. In this case all dags can run parallel.
> I just migrated to System D and even though I have the same configuration I 
> can't run dags parallel.
> Just an example:
>  # When one job is running 30 minutes (for example spark execution) rest of 
> them are queueing. This problem stop execution for rest of jobs not so heavy.
>  # When dag's code is failed scheduler doesn't execute rest of dags. .
> I have no celery configuration. Does celery with system D resolve my problems 
> ?

This message was sent by Atlassian JIRA

Reply via email to