Hey everyone, Thank you for attending the dev call on the 4th. Apologies for the belated notes this time. I updated our meeting notes document in the Airflow 3.x wiki <https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+3.x>to capture the notes. The link for those notes is here <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=373886699#Airflow3.xDevCall:Meetingnotes-Summary.13>
To everyone who attended the meeting, please check the summary and add anything that I may have missed. For those who could not join, please let us know if you disagree with anything discussed and agreed upon in the meeting. Also, please do ask questions if something is unclear. Our next meeting is scheduled for tomorrow the 18th of December at the same time. The agenda is pretty open at this time and I know that a fair number of people are out, so may end up cancelling this. If you would like to keep this call to discuss a particular topic, please let me know if you would like to add anything to the agenda <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=373886699#Airflow3.xDevCall:Meetingnotes-ProposedAgenda.14> . Best regards, Vikram -- Below is the summary from the call: - Development Updates - Airflow 3.1.4 patch release update (Ephraim Anierobi) - Ephraim shared that the 3.1.4 patch release had around 47 bug fixes, with a total of around 183 pull requests. - Key fixes included task clearing race conditions in backfills when multiple schedulers are active, deadline alert handling, local executor memory leaks and N+1 query improvements. - There are also several UI improvements including task highlighting in the graph view and mobile layout. - Task SDK / Shared libraries update (Amogh Desai) - Amogh said that the "shared library" effort is nearly complete now with 7 libraries identified for decoupling Task SDK from Airflow Core. - Out of these seven, five have already been completed and merged. The two remaining are for traces/metrics and listeners. - Amogh and Jarek gave a shoutout to Christos for the work here! - UI E2E Testing framework update (Rahul Vats) - Rahul shared that the playwright based framework PR for testing was merged and that CI work is in progress to trigger these tests for UI changes. - Rahul said that he had created a meta issue containing all the test scenarios organized by page and that the plan was to focus on critical flows and recent UI issues such as pagination. - Rahul asked for community contributions here and was considering a phased rollout. - Discussion Topics - Providers documented release plan (Jens Scheffler / Jarek Potiuk) - Jens said he had created a draft release for providers in Confluence to help coordinate the work between release managers. - Jens said that it currently covered Provider releases and could be expanded to others. - Jens asked where the Core Airflow releases were documented and Vikram shared that they were documented in the Airflow 3.x wiki page, but was out of date for the 3.1.4 page - Jens also asked if there were any objections to moving the provider releases from Thursday to Tuesday to facilitate easier validation on weekdays instead of weekends. The release managers agreed to this. - Helm chart scope and strategy (Jens, Jarek, Jed) - There was a quick reference to the dev list email about dropping support for Airflow 1 in the helm chart and that there would be a lazy consensus follow up to the same - There was much longer discussion on the overall scope of the Helm chart, including changes for the embedded database support in the helm chart. There also was a reference to potentially adopting Kustomize as a way to simplify the chart and to extend it for edge cases using Kustomize. There was no immediate agreement here, other than to continue the discussion async on the dev list. - Airflow 3.2 potential scope - Vikram started the discussion saying that it would be good to get an overall scope and plans together for 3.2 release with the target timeline of March 2026. - Vikram also added that Daniel Standish had updated the Asset Partitions AIP with the focus on 3.2. - Vincent added that the multi-team work was progressing and that they would be targeting an experimental release in time for 3.2 to enable user testing and feedback, with a goal of an official release in Airflow 3.3 later in the year. - Rajesh added that Dennis was actively working on the Deadline Alerts sync callback work with a target of 3.2 release. - The team noted that there were several large AIPs being discussed and that we need to get some formal scope and planning together in order to identify the interactions between these AIPs. Vikram took the action item to ask and help these AIP authors formalize scope and timelines. - Rookie awards vote (Srabasti) - Vikram said that Srabasti Banerjee had wanted to remind the team to vote for the "new budding contributor" awards on the dev list before the deadline. -- Vikram Koka Chief Strategy Officer Email: [email protected] <https://www.astronomer.io/>
