Woooho! On Tue, Nov 10, 2020 at 12:00 AM Ash Berlin-Taylor <[email protected]> wrote:
> I'm proud to announce the availability of Apache Airlow 2.0.0.beta1 for > testing. > > This now marks us being "feature complete" for core Airflow -- from now on > any significant new features to core Airflow will have to wait until 2.1 -- > but thanks to the split out of provider packages those can continue to be > developed. > > This "snapshot" is intended for members of the Airflow developer community > to test the build and get an early start on testing 2.0.0. For clarity, > this is not an official release of Apache Airflow either - that doesn't > happen until we make a release candidate and then vote on that, and based > on the expected timelines on the Airflow 2.0 planning page > <https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+2.0+-+Planning>, > we expect that to happen the week of 7th December, 2020. > > Apache Airflow > > The beta snapshot is available at: > > https://dist.apache.org/repos/dist/dev/airflow/2.0.0b1/ > <https://dist.apache.org/repos/dist/dev/airflow/2.0.0a1/> > > *apache-airflow-2.0.0b1-source.tar.gz* is a source release that comes with > INSTALL instructions. > > *apache-airflow-2.0.0b1-bin.tar.gz* is the binary Python "sdist" snapshot. > > *apache_airflow-2.0.0b1-py3-none-any.whl* is the binary Python wheel > snapshot. > > This snapshot *has* been pushed to PyPi. > > Major features since alpha2: > > * "Decorated Flow" renamed to "TaskFlow API" (we should be sticking with > this name now) > * Further significant performance improvements to CeleryExecutors task > launching speed (down from 2-3 seconds per task to 0.2seconds!) > * UI home page has been overhauled to make a better use of space. > > The full changelog for core airflow (excluding providers and a few other > internal things) since alpha2 is below. > > Provider Packages > > We have also released the 1.0.0b1 of the providers (not backports!) which > can be found at > > https://dist.apache.org/repos/dist/dev/airflow/providers/1.0.0b1/ > We also made those versions available on PyPi for convenience ('pip > install --pre apache-airflow-providers-*'): > > https://pypi.org/search/?q=apache-airflow-providers > > The documentation and changelogs are available in the readme of the PyPI > packages -- see the end of this email for links to individual PyPi packages > > > Public keys for all releases are available at: > https://www.apache.org/dist/airflow/KEYS > > Airflow Changelog: > > *New Features* > > * Adds automated installation of dependent packages > * Render k8s yaml for tasks via the Airflow UI (#11815) > * Remove the ability to add hooks to airflow.hooks namespace (#12108) > * Add ability to specify pod_template_file in executor_config (#11784) > * Add SIGUSR2 handler to Scheduler to dump executor state (#12107) > * Remove the ability to import operators and sensors from plugins (#12072) > * Change Decorated Flow to TaskFlow API (#11895) > * Add Kubernetes cleanup-pods CLI command for Helm Chart (#11802) > * Perform "mini scheduling run" after task has finished (#11589) > * Allow airflow.providers to be installed in multiple python folders > (#10806) > * Add Flower Authentication to Helm Chart (#11836) > * Disable XCom pickling by default (#11991) > * Fix: Responsive layout of DAGs (Home) view (#11958) > * Speed up task execution in Celery by pre-loading "expensive" modules > (#11956) > * Fix oversized width of DAGs table with hide/reveal of "links" (#11866) > * Use resource permissions for Airflow view access (#11362) > * Make Dag Serialization a hard requirement (#11335) > > *Improvments* > > * Extend the same keyword args callable support in PythonOperator to some > other sensors/operators (#11922) > * Filter dags by owner (#11121) > * Remove BaseDag and BaseDagBag classes (#12195) > * Don't include provider datafiles in the apache-airflow sdist (#12196) > * Call scheduler "book-keeping" operations less frequently. (#12139) > * Fix broken 'Blocked Highlight' feature in UI (#12183) > * Add authentication to AWS with Google credentials (#12079) > * Proper title for XCom List View page (#12169) > * Make doc_md field nullable and raise json for non-existing dag in dag > detail endpoint (#12142) > * Retry Publishing Task to Celery Broker (#12140) > * Update to new helm stable repo (#12137) > * Override FAB table views where table width extends beyond parent > containers (#12048) > * Update doc images to reflect latest UI (#11984) > * Allow fractional seconds for timeout values (#11966) > * Log instead of raise an Error for unregistered OperatorLinks (#11959) > * Upgrade FAB to 3.1.1 (#11884) > > *Bug Fixes* > > * Include data files in (backport) provider packages (#12200) > * Sync FAB Permissions for all base views (#12162) > * fix spacing between table and pagination (#12160) > * Fix default values for Helm Chart (#12153) > * airflow info fixed for python 3.8+ (#12132) > * Correct failure message in sql_sensor.py. (#12057) > * Avoid unnecessary IF checks when generate Duration & Landing Time views > (#12075) > * Retry Dagbag.sync_to_db to avoid Deadlocks (#12046) > * Refine request check in api_connextion Pool endpoints (#12019) > * fix helm scheduler deployment / scheduler logs (#11685) > * fix helm chart worker deployment without kerberos (#11681) > * Unpin werkzeug & set default cookie_samesite to Lax (#11873) > > *Docs* > > * Fixed path of the test_core.py file in docs (#12191) > * Move metrics configuration to new section - metrics (#12165) > * Added 1.10.x section to Upgrading to 2.0 doc (#12173) > * Allow Connection Edit View to handle entries with NULL 'extra' (#12149) > * Move docs for max_db_retries option to core (#12167) > * Changed tutorial file to reflect name change to TaskFlow API (#12099) > * Fix typo in docker-context-files/README.md (#12078) > * Delete an environment-dependent value from CLI documentation (#12055) > * Adds updating note to ariflowignore fix (#12043) > * Fix incorrect .airflowignore behavior with multiple nested directories > (#11994) > * Replace Docs GIF with updated UI screenshots (#12044) > * Ignore the basepath when ignoring files via .airflowignore (#11993) > * Adds documentation about the optimized PR workflow (#12006) > * Improve formatting in configurations docs (#11987) > * Add docs about Scheduler HA, how to use it and DB requirements (#11467) > * Add readme for core sensors, standardize capitalization schema (#11898) > * Updating 2.0 docs (#11842) > * Add providers, operators, and hooks readmes (#11829) > > *Misc/Internal* > > * Format all files (without excepions) by black (#12091) > * Enable Black - Python Auto Formmatter (#9550) > * Use PyUpgrade to use Python 3.6 features (#11447) > * Replace deprecated PythonOperator module with the new one (#12064) > * Remove unused JavaScript function (#12052) > * Code smell fixes for BackfillJob (#12005) > * All k8s object must comply with JSON Schema (#12003) > * Validate airflow chart values.yaml & values.schema.json (#11990) > * Remove unused "poke_exception_cache_ttl" param from SmartSensorOperator > (#11972) > * Migrate from helm-unittest to python unittest (#11827) > * Migration commands shouldn't print a bunch of data. (#11961) > * Cache CLI parser objects (#11957) > * Add missing space to log message in task completion logs (#11934) > * Fix issue rendering k8s V1Pod (#11952) > * Make taskinstances pid and duration nullable (#11906) > > Provider Packages PyPi Links: > > https://pypi.org/project/apache-airflow-providers-amazon/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-cassandra/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-druid/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-hdfs/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-hive/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-kylin/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-livy/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-pig/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-pinot/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-spark/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-apache-sqoop/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-celery/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-cloudant/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-databricks/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-datadog/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-dingding/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-discord/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-docker/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-elasticsearch/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-exasol/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-facebook/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-ftp/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-google/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-grpc/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-hashicorp/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-http/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-imap/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-jdbc/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-jenkins/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-jira/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-microsoft-azure/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-microsoft-mssql/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-microsoft-winrm/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-mongo/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-mysql/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-odbc/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-openfaas/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-opsgenie/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-oracle/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-pagerduty/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-papermill/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-plexus/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-postgres/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-presto/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-qubole/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-redis/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-salesforce/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-samba/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-segment/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-sftp/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-singularity/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-slack/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-snowflake/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-sqlite/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-ssh/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-vertica/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-yandex/1.0.0b1/ > https://pypi.org/project/apache-airflow-providers-zendesk/1.0.0b1/ > > -- Jarek Potiuk Polidea <https://www.polidea.com/> | Principal Software Engineer M: +48 660 796 129 <+48660796129> [image: Polidea] <https://www.polidea.com/>
