+1 Tested the Data Dependency Management and Data Driven Scheduling (defined in AIP-48), with Datasets created and configured as dependencies between DAGs. Tested the DAG triggering using these. Also tested the new Datasets View and the updated Dag Dependencies View.
This looks amazing and so excited to see this come together! Vikram On Fri, Sep 16, 2022 at 1:41 AM Jarek Potiuk <ja...@potiuk.com> wrote: > +1. Tested signature, checksums licences. Installed and ran airflow > locally with a number of DAGs and examples. > > One more comment - sorry I could not stop myself. The new datasets feature > acts and feels like magic. > > I've been only looking over the shoulders of the team that implemented it > and I kinda knew what to expect, but what we get in 2.4.0 pretty much > exceeds my expectations. > > The few examples we have embedded are enough to show how great a feature > it is. It really feels magical when you have dataset dependencies between > DAGs and you observe what's going on when one dags finishes and dependent > dags start. This is going to be huge. > > J. > > > On Thu, Sep 15, 2022 at 10:27 PM Jarek Potiuk <ja...@potiuk.com> wrote: > >> Done. Tested. Released. Long time ago. >> >> On Thu, Sep 15, 2022 at 10:13 PM Jed Cunningham <jedcunning...@apache.org> >> wrote: >> >>> Of course, I meant the vote will last until Sunday, September 18, *2022* >>> (not 2021) at 8:00 pm UTC. Sorry about that! >>> >>
