Awesome! Thanks Michael :) pt., 29 lip 2022 o 21:34 Jarek Potiuk <[email protected]> napisał(a):
> Nice! > > On Fri, Jul 29, 2022 at 9:32 PM Michael Robinson via users < > [email protected]> wrote: > >> View this email in your browser >> <https://mailchi.mp/627a8910cc73/apache-airflow-newsletter-july-2022?e=ce16eef4ef> >> >> This month in the Airflow community, we released Airflow 2.3.3 >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=1bd27974f1&e=ce16eef4ef> >> and over 40 Airflow Providers packages >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=aaec9074c7&e=ce16eef4ef>, >> including the new Common SQL shared provider and the new Tabular provider. >> We learned and networked at an Airflow Meetup in Tel Aviv >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=51d4c8cc3e&e=ce16eef4ef> >> and Google’s Airflow Day 2022 >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=2f955a2dfd&e=ce16eef4ef>, >> and over on the dev list we discussed Dynamic Yield’s “Magic Loop” >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7cf95cdc1d&e=ce16eef4ef> >> for minimizing delays caused by many concurrent dynamic DAGs, among >> other topics. >> >> The newsletter is moving to a new platform, Mailchimp. Please subscribe >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=096e67c8c1&e=ce16eef4ef> >> to ensure you always receive the latest issue. >> >> We can always use speakers for meetups. If you want to present your >> Airflow contribution, demo your project, or share your experience at a >> Community Meetup this year, let us know >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e7fc2b5028&e=ce16eef4ef>. >> You could win some excellent swag! >> >> - >> >> August 9: “Airflow 101: Essential Tips for Beginners” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=166096c917&e=ce16eef4ef> >> - >> >> August 10: “Build a Robust Data Pipeline with Airflow, dbt, and Great >> Expectations – with Interactivity” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7dbc8d0b3e&e=ce16eef4ef> >> - >> >> August 17: “Using Plugins for Webserver” with Faizan Qazi (details >> TBA on Clowder >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=88a3d50cba&e=ce16eef4ef> >> ) >> >> We released Airflow 2.3.3. You can find the build artifacts using these >> links: >> >> - PyPI >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=0d09446543&e=ce16eef4ef> >> | Notes >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=e2c70b8cbd&e=ce16eef4ef> >> | Constraints >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=901d8a64b3&e=ce16eef4ef> >> - Docker image: apache/airflow:2.3.3 >> >> We released Airflow Providers packages. You can find them using these >> links: >> >> - Sources >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=22c14f066e&e=ce16eef4ef> >> | Guide >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=63b31b2c5a&e=ce16eef4ef> >> >> *@uranusjr >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=5143e93b2b&e=ce16eef4ef>* >> >> *#24989 Implement expand_kwargs() >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=f4d747431b&e=ce16eef4ef>* >> Implements a new ExpandInput type, "list-of-dicts", to support this new >> shape of mapped kwargs. >> To nominate a PR >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7d9a79856a&e=ce16eef4ef> >> for a future issue, flag it by adding *#protm* to a comment. >> >> If you missed any of these, you can catch a recap, watch on-demand, or >> dig into the slides: >> >> - >> >> July 28: “Apache Airflow TLV Meetup Summer Edition” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=48722ecbf9&e=ce16eef4ef> >> - >> >> July 27: “Airflow, Spark, Trinio and Data Engineering Best Practices” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4aa33f35f0&e=ce16eef4ef> >> >> - >> >> July 26: “Using Airflow with Tensorflow and MLFlow” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=31433f5b8d&e=ce16eef4ef> >> - >> >> July 15: “Data Engineering: Bulk Up Your Data Eng Skills using >> Airflow, Spark & DASK” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=bc6157ff5d&e=ce16eef4ef> >> - >> >> July 14: “Apache Airflow – Future of Data Workflows” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=b776db73d0&e=ce16eef4ef> >> - >> >> July 12: “Anatomy of an Operator” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4aa8403602&e=ce16eef4ef> >> >> - >> >> July 7: "Airflow Day 2022 on Google Open Source Live" >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=052c3897b0&e=ce16eef4ef> >> >> >> >> - >> >> July 6: “Introduction to Building Pipelines in GCP using Airflow” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=ea6a2f2893&e=ce16eef4ef> >> >> >> - >> >> “Is Airflow the Right Choice for Machine Learning, Too?,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=6213fd2ecd&e=ce16eef4ef> >> by Samhita Alla, BetterProgramming/Medium >> - >> >> “Deutsche Bank uses Cloud Composer Workload Automation,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9e495b03f8&e=ce16eef4ef> >> cnxtoday.com >> - >> >> “Shopify’s Practical Guidelines from Running Airflow for ML and Data >> Workflows at Scale,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=143cd0347e&e=ce16eef4ef> >> by Reza Rahimi, infoq.com >> - >> >> “Magic Loop in Airflow – Reloaded,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=c3257fbba3&e=ce16eef4ef> >> by Jarek Potiuk, Apache Airflow/Medium >> - >> >> “Shared Volumes in Airflow – the Good, the Bad, and the Ugly,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=9046873bce&e=ce16eef4ef> >> by Jarek Potiuk, Apache Airflow/Medium >> - >> >> “Running Airflow on ARM M1/M2? Hell Yes, but Upgrade to 2.3+,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=a782285305&e=ce16eef4ef> >> by Jarek Potiuk, Apache Airflow/Medium >> - >> >> “Generic Airflow Transfers Made Easy,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=eeb6b8d1cb&e=ce16eef4ef> >> by Jarek Potiuk, Apache Airflow/Medium >> - >> >> “Airflow’s Magic Loop,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cac6eafbf4&e=ce16eef4ef> >> by Itay Bittan, Towards Data Science/Medium >> - >> >> “Load Data from Postgres to BigQuery with Airflow,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=7d83f3800a&e=ce16eef4ef> >> by Giorgos Myrianthous, Towards Data Science/Medium >> - >> >> “Automated Alerts for Airflow from Slack,” >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=aa3832265c&e=ce16eef4ef> >> by Chris Young, Towards Data Science/Medium >> >> >> - >> >> *Votes: * >> - >> >> Airflow 2.3.3rc1 release (approved) >> - >> >> Airflow 2.3.3 release (approved) >> - >> >> Airflow Providers (RC1) (approved) >> - >> >> July’s PR of the Month (approved) >> - >> >> Release Airflow Python client 2.3.0 based on 2.3.0rc1 (pending) >> - >> >> *Lazy consensus:* >> - >> >> Deprecate “dependency detector” pluggability (passed) >> - >> >> *Discussed:* >> - >> >> “Magic Loop” as first-class citizen in Airflow >> - >> >> Airflow scheduling delay metric definition >> - >> >> Grouping of concerns >> - >> >> Migrate Airflow code to use PEP 563 (postponed evaluation of >> annotations) >> - >> >> Standard way of getting provider version? >> - >> >> Trimming down Airflow versions in issues >> - >> >> Deprecating the SLA feature? >> - >> >> Implementing a testing framework for Airflow >> - >> >> Consolidate DAG scheduling params >> - >> >> *Proposed:* >> - >> >> Provider’s mixed governance model >> - >> >> Simplification of WWW asset compilation for Breeze/dev env >> >> >> - >> >> Airflow 2.4.0 >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=d0f3d39055&e=ce16eef4ef> >> >> This release will focus on new features. >> >> - >> >> Airflow Helm Chart 1.7.0 >> >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=cfff66719b&e=ce16eef4ef> >> >> The next release for the Airflow Helm Chart, fixing bugs and adding more >> features. >> For more info about upcoming releases and in-development projects, visit >> the current projects issue (#10176 >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=4c64a96866&e=ce16eef4ef> >> ). >> >> The newsletter is moving to a new platform, Mailchimp. Please subscribe >> <https://apache.us14.list-manage.com/track/click?u=fe7ef7a8dbb32933f30a10466&id=05b5c570d8&e=ce16eef4ef> >> to ensure you always receive the latest issue. >> Is there an event or publication the community should know about? Let us >> know at [email protected] <[email protected]> or >> [email protected]. >> Want to change how you receive these emails? >> You can update your preferences >> <https://apache.us14.list-manage.com/profile?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=b4d78fe0f4> >> or unsubscribe from this list >> <https://apache.us14.list-manage.com/unsubscribe?u=fe7ef7a8dbb32933f30a10466&id=65cb5665fa&e=ce16eef4ef&c=b4d78fe0f4> >> . >> >> >>
