Hi Jeremiah, We've been struggling with this problem as well. If you set the concurrency parameter on a Dag to 1, the docstring states this will only relate to task instances, and not to dag_run instances, which I think David is referring to.
:param concurrency: the number of task instances allowed to run concurrently :type concurrency: int -----Original Message----- From: Jeremiah Lowin [mailto:[email protected]] Sent: vrijdag 28 april 2017 12:51 To: [email protected] Subject: Re: Force DAGs run up to the last task Hi David -- you'll want to set the concurrency parameter of your DAG to 1. J On Fri, Apr 28, 2017 at 4:12 AM David Batista <[email protected]> wrote: > Hello everyone, > > is there a simple way to tell Airflow to only start running another > DAG when all the tasks for the current running DAG are completed? > i.e., when a DAG is triggered Airflow first runs all the tasks for > that DAG, and only then picks up another DAG to run. > > > -- > *David Batista* *Data Engineer**, HelloFresh Global* Saarbrücker Str. > 37a | 10405 Berlin [email protected] <[email protected]> > > -- > > [image: logo] > <http://www.facebook.com/hellofreshde> < > http://twitter.com/HelloFreshde> > <http://instagram.com/hellofreshde/> <http://blog.hellofresh.de/> > < > https://app.adjust.com/ayje08?campaign=Hellofresh&deep_link=hellofresh > %3A%2F%2F&post_deep_link=https%3A%2F%2Fwww.hellofresh.com%2Fapp%2F%3Fu > tm_medium%3Demail%26utm_source%3Demail_signature&fallback=https%3A%2F% > 2Fwww.hellofresh.com%2Fapp%2F%3Futm_medium%3Demail%26utm_source%3Demai > l_signature > > > > *HelloFresh App –Download Now!* > < > https://app.adjust.com/ayje08?campaign=Hellofresh&deep_link=hellofresh > %3A%2F%2F&post_deep_link=https%3A%2F%2Fwww.hellofresh.com%2Fapp%2F%3Fu > tm_medium%3Demail%26utm_source%3Demail_signature&fallback=https%3A%2F% > 2Fwww.hellofresh.com%2Fapp%2F%3Futm_medium%3Demail%26utm_source%3Demai > l_signature > > > *We're active in:* > US < > https://www.hellofresh.com/?utm_medium=email&utm_source=email_signatur > e> > | DE > <https://www.hellofresh.de/?utm_medium=email&utm_source=email_signatur > e> | UK > <https://www.hellofresh.co.uk/?utm_medium=email&utm_source=email_signa > ture > > > | NL > <https://www.hellofresh.nl/?utm_medium=email&utm_source=email_signatur > e> | AU < > https://www.hellofresh.com.au/?utm_medium=email&utm_source=email_signa > ture > > > | BE > <https://www.hellofresh.be/?utm_medium=email&utm_source=email_signatur > e> | AT > <https://www.hellofresh.at/?utm_medium=email&utm_source=email_signatur > e > > > | CH > <https://www.hellofresh.ch/?utm_medium=email&utm_source=email_signatur > e> | CA > <https://www.hellofresh.ca/?utm_medium=email&utm_source=email_signatur > e > > > > www.HelloFreshGroup.com > < > http://www.hellofreshgroup.com/?utm_medium=email&utm_source=email_sign > ature > > > > We are hiring around the world – Click here to join us < > https://www.hellofresh.com/jobs/?utm_medium=email&utm_source=email_sig > nature > > > > -- > > < > https://www.hellofresh.com/jobs/?utm_medium=email&utm_source=email_sig > nature > > > HelloFresh SE, Berlin (Sitz der Gesellschaft) | Vorstände: Dominik S. > Richter (Vorsitzender), Thomas W. Griesel, Christian Gärtner | > Vorsitzender des Aufsichtsrats: Jeffrey Lieberman | Eingetragen beim > Amtsgericht Charlottenburg, HRB 182382 B | USt-Id Nr.: DE 302210417 > > *CONFIDENTIALITY NOTICE:* This message (including any attachments) is > confidential and may be privileged. It may be read, copied and used > only by the intended recipient. If you have received it in error > please contact the sender (by return e-mail) immediately and delete > this message. Any unauthorized use or dissemination of this message in > whole or in parts is strictly prohibited. >
