+1 for me, I like the idea. General (Internal Property) ________________________________ From: Dheeraj Turaga <[email protected]> Sent: Saturday, September 26, 2026 17:23 To: [email protected] <[email protected]> Subject: Re: [LAZY CONSENSUS] Deprecate cyclic TaskGroup dependencies in 3.4, reject them in 3.5
EXTERNAL MAIL: Indien je de afzender van deze e-mail niet kent en deze niet vertrouwt, klik niet op een link of open geen bijlages. Bij twijfel, stuur deze e-mail als bijlage naar [email protected]<mailto:[email protected]>. Apologies: here's the initial discussion link: https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.apache.org%2Fthread%2Fsossl7b2w2ftyk4028qrhps2tcdxj2px&data=05%7C02%7Cdavid.blain%40infrabel.be%7C27b929bcaacb46be06d208df1be23d27%7Cb82bc314ab8e4d6fb18946f02e1f27f2%7C0%7C0%7C639260330641563693%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=%2BgKpkOq68zLi%2Bm4YDz5313%2BRc3V2Rgs%2Bd2Mb3MTyqaQ%3D&reserved=0<https://lists.apache.org/thread/sossl7b2w2ftyk4028qrhps2tcdxj2px> On Sat, Sep 26, 2026 at 4:44 AM Jarek Potiuk <[email protected]> wrote: > I think the list link is wrong :( > > On Sat, Sep 26, 2026 at 7:03 AM Dheeraj Turaga <[email protected]> wrote: > > > Hi all, > > > > Following the discussion [1], I'm calling for lazy consensus on how we > > handle Dags whose TaskGroups depend on each other in a cycle when each > > group is treated as a single unit (their task dependencies themselves > > are acyclic). > > > > Proposal: > > > > 1. In 3.4.0, fix the Grid/Graph HTTP 500 for these Dags [2]. We need this > > fix regardless: filtering the Grid or Graph view can create such a > > cycle in a Dag that has none. > > > > 2. Also in 3.4.0, deprecate these Dags [3]. Parsing them issues a > > TaskGroupCycleDeprecationWarning and shows a Dag warning in the UI > > naming the TaskGroups involved. They keep parsing and running. > > > > 3. From 3.5.0, reject them at parse time with an import error [4]. As > > Jarek suggested, we treat this as a bug fix, since these dependencies > > were never intended to be supported. This is an exception to our > > deprecation policy, which would otherwise keep deprecated behaviour > > working until 4.0. > > > > 4. Scope: only cycles between TaskGroups. Other restrictions on > > dependencies into or out of TaskGroups are out of scope and would need > > their own discussion. > > > > The lazy consensus is open for 72 hours, until Tuesday, 29 September > 2026, > > 05:00 UTC. If there are no objections by then, I'll consider it accepted. > > > > [1] > > https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.apache.org%2Fthread%2Fsossl7b2w2ftyk4028qrhps&data=05%7C02%7Cdavid.blain%40infrabel.be%7C27b929bcaacb46be06d208df1be23d27%7Cb82bc314ab8e4d6fb18946f02e1f27f2%7C0%7C0%7C639260330641579898%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=srHXgfHPPFh58UvJ1PtgZ%2BxDoOUbs%2FUxTeNsTgGLnGY%3D&reserved=0<https://lists.apache.org/thread/sossl7b2w2ftyk4028qrhps> > > [2] > > https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fairflow%2Fpull%2F73724&data=05%7C02%7Cdavid.blain%40infrabel.be%7C27b929bcaacb46be06d208df1be23d27%7Cb82bc314ab8e4d6fb18946f02e1f27f2%7C0%7C0%7C639260330641590896%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=Sb7V7DnktBDTc7fXvihn7DBxabphMKMOP90Hb7pQ31M%3D&reserved=0<https://github.com/apache/airflow/pull/73724> > > [3] > > https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fairflow%2Fpull%2F73746&data=05%7C02%7Cdavid.blain%40infrabel.be%7C27b929bcaacb46be06d208df1be23d27%7Cb82bc314ab8e4d6fb18946f02e1f27f2%7C0%7C0%7C639260330641601911%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=uEWIbeNG9z1rGI4jUlNIqDDeLh%2BKnHz59dfiNTM0OYQ%3D&reserved=0<https://github.com/apache/airflow/pull/73746> > > [4] > > https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fairflow%2Fpull%2F73087&data=05%7C02%7Cdavid.blain%40infrabel.be%7C27b929bcaacb46be06d208df1be23d27%7Cb82bc314ab8e4d6fb18946f02e1f27f2%7C0%7C0%7C639260330641612347%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=DE%2B7D6hfBlfw5H9ZGnrY4ZwhBIVbzpcsCSRmzna77x8%3D&reserved=0<https://github.com/apache/airflow/pull/73087> > > > > Thanks, > > Dheeraj > > >
