My apologies, I didn't read closely enough. Concurrency does indeed refer
to tasks, not dagruns. As Bolke points out, I believe the only mechanism to
restrict dagruns is depends_on_past, which will limit both concurrency and
ordering.

On Fri, Apr 28, 2017 at 7:11 AM Wim Berchmans <[email protected]>
wrote:

> Hi Jeremiah,
>
> We've been struggling with this problem as well.
> If you set the concurrency parameter on a Dag to 1, the docstring states
> this will only relate to task instances, and not to dag_run instances,
> which I think David is referring to.
>
> :param concurrency: the number of task instances allowed to run
> concurrently
> :type concurrency: int
>
>
>
>
> -----Original Message-----
> From: Jeremiah Lowin [mailto:[email protected]]
> Sent: vrijdag 28 april 2017 12:51
> To: [email protected]
> Subject: Re: Force DAGs run up to the last task
>
> Hi David -- you'll want to set the concurrency parameter of your DAG to 1.
>
> J
>
> On Fri, Apr 28, 2017 at 4:12 AM David Batista <[email protected]> wrote:
>
> > Hello everyone,
> >
> > is there a simple way to tell Airflow to only start running another
> > DAG when all the tasks for the current running DAG are completed?
> > i.e., when a DAG is triggered Airflow first runs all the tasks for
> > that DAG, and only then picks up another DAG to run.
> >
> >
> > --
> > *David Batista* *Data Engineer**, HelloFresh Global* Saarbrücker Str.
> > 37a | 10405 Berlin [email protected] <[email protected]>
> >
> > --
> >
> > [image: logo]
> >   <http://www.facebook.com/hellofreshde>   <
> > http://twitter.com/HelloFreshde>
> >    <http://instagram.com/hellofreshde/>   <http://blog.hellofresh.de/>
> > <
> > https://app.adjust.com/ayje08?campaign=Hellofresh&deep_link=hellofresh
> > %3A%2F%2F&post_deep_link=https%3A%2F%2Fwww.hellofresh.com%2Fapp%2F%3Fu
> > tm_medium%3Demail%26utm_source%3Demail_signature&fallback=https%3A%2F%
> > 2Fwww.hellofresh.com%2Fapp%2F%3Futm_medium%3Demail%26utm_source%3Demai
> > l_signature
> > >
> >
> > *HelloFresh App –Download Now!*
> > <
> > https://app.adjust.com/ayje08?campaign=Hellofresh&deep_link=hellofresh
> > %3A%2F%2F&post_deep_link=https%3A%2F%2Fwww.hellofresh.com%2Fapp%2F%3Fu
> > tm_medium%3Demail%26utm_source%3Demail_signature&fallback=https%3A%2F%
> > 2Fwww.hellofresh.com%2Fapp%2F%3Futm_medium%3Demail%26utm_source%3Demai
> > l_signature
> > >
> > *We're active in:*
> > US <
> > https://www.hellofresh.com/?utm_medium=email&utm_source=email_signatur
> > e>
> >  |  DE
> > <https://www.hellofresh.de/?utm_medium=email&utm_source=email_signatur
> > e> | UK
> > <https://www.hellofresh.co.uk/?utm_medium=email&utm_source=email_signa
> > ture
> > >
> > |  NL
> > <https://www.hellofresh.nl/?utm_medium=email&utm_source=email_signatur
> > e> | AU <
> > https://www.hellofresh.com.au/?utm_medium=email&utm_source=email_signa
> > ture
> > >
> >  |  BE
> > <https://www.hellofresh.be/?utm_medium=email&utm_source=email_signatur
> > e> | AT
> > <https://www.hellofresh.at/?utm_medium=email&utm_source=email_signatur
> > e
> > >
> > |  CH
> > <https://www.hellofresh.ch/?utm_medium=email&utm_source=email_signatur
> > e> | CA
> > <https://www.hellofresh.ca/?utm_medium=email&utm_source=email_signatur
> > e
> > >
> >
> > www.HelloFreshGroup.com
> > <
> > http://www.hellofreshgroup.com/?utm_medium=email&utm_source=email_sign
> > ature
> > >
> >
> > We are hiring around the world – Click here to join us <
> > https://www.hellofresh.com/jobs/?utm_medium=email&utm_source=email_sig
> > nature
> > >
> >
> > --
> >
> > <
> > https://www.hellofresh.com/jobs/?utm_medium=email&utm_source=email_sig
> > nature
> > >
> > HelloFresh SE, Berlin (Sitz der Gesellschaft) | Vorstände: Dominik S.
> > Richter (Vorsitzender), Thomas W. Griesel, Christian Gärtner |
> > Vorsitzender des Aufsichtsrats: Jeffrey Lieberman | Eingetragen beim
> > Amtsgericht Charlottenburg, HRB 182382 B | USt-Id Nr.: DE 302210417
> >
> > *CONFIDENTIALITY NOTICE:* This message (including any attachments) is
> > confidential and may be privileged. It may be read, copied and used
> > only by the intended recipient. If you have received it in error
> > please contact the sender (by return e-mail) immediately and delete
> > this message. Any unauthorized use or dissemination of this message in
> > whole or in parts is strictly prohibited.
> >
>

Reply via email to