This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch v2-8-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 2c10e93f67 Update version of airflow to 2.8.1.dev0
new 00ee94bb64 Add code snippet formatting in docstrings via Ruff (#36262)
new 097659eb5b Move removal of chicken-egg providers to before releasing
image (#36286)
new b3031114b8 Remove additional generation of dependencies when building
CI images (#36283)
new 8986f8f3be Fix using extras when `--use-airflow-version` is used in
Breeze (#36280)
new 75dc157950 Add steps to update constraints and adjust version for
chicken-egg (#36288)
new 2cad58ad4e Updating version of airflow pre-commit should happen when
version change (#36293)
new c284ece145 Less verbose information about changed provider.yaml files
(#36307)
new b06b1fc8be Airflow 2.8.0 has been released (#36298)
new a51887bcb7 Update the release date of Airflow 2.8.0 (#36321)
new ae0ceb382d Improve pre-commit to generate Airflow diagrams as a code
(#36333)
new 0d12706dd9 Remove rendundant and unused code in docs
building/publishing (#36346)
new d79f7a4027 Fix problems with missing selective checks on new types of
unit tests (#36372)
new 99ec731487 Fix --use-airflow-version constraints (#36378)
new 7985fa898a Add note for release manager about updating the states of
providers (#36392)
new e49c573d9c Update release process for providers to include mixed RC
versions (#36385)
new 879af06000 Use default Postgres version for Quarantined tests (#36390)
new 0db3bc6b53 Add feture of "not-ready" provider. (#36391)
new d853785703 Automate rcN calculation when releasing provider packages
(#36441)
new e1d2e7f3b5 Update BREEZE.rst with different test example (#36234)
new 5576e1151d Update providers metadata 2023-12-28 (#36459)
new 00fc3db79a Remove pypitest from the release process (#36466)
new e3316c36b4 Fix preparing rc candidates for providers (#36465)
new 21a411d58f Add utkarsharma2 to committers list (#36474)
new b9ef5a0898 Improve generation of "Status of testing" issue (#36470)
new dd6572fb03 Check executable permission for entrypoints at breeze start
(#36482)
new a161e6eb6e Add zlib1g-dev package to Airflow images (#36493)
new 94186a04f1 Bump stalebot to version 9 (#36494)
The 27 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 17 +-
.github/actions/build-ci-images/action.yml | 4 +-
.github/workflows/build-images.yml | 1 +
.github/workflows/ci.yml | 9 +-
.github/workflows/recheck-old-bug-report.yml | 8 +-
.github/workflows/stale.yml | 2 +-
.pre-commit-config.yaml | 10 +-
.rat-excludes | 3 +
BREEZE.rst | 2 +-
CONTRIBUTING.rst | 45 ++
Dockerfile | 4 +-
Dockerfile.ci | 2 +-
RELEASE_NOTES.rst | 2 +-
TESTING.rst | 2 +-
airflow/io/path.py | 4 +-
airflow/macros/__init__.py | 8 +-
airflow/models/baseoperator.py | 18 +-
airflow/models/dag.py | 7 +-
airflow/models/taskinstance.py | 4 +
airflow/models/xcom_arg.py | 4 +-
airflow/provider.yaml.schema.json | 4 +
airflow/providers/amazon/aws/operators/s3.py | 20 +-
.../providers/amazon/aws/operators/sagemaker.py | 13 +-
.../providers/apache/cassandra/hooks/cassandra.py | 6 +-
.../providers/apache/cassandra/sensors/record.py | 10 +-
.../providers/apache/cassandra/sensors/table.py | 6 +-
airflow/providers/apache/hive/hooks/hive.py | 23 +-
airflow/providers/apache/hive/macros/hive.py | 6 +-
.../providers/databricks/operators/databricks.py | 18 +-
airflow/providers/ftp/operators/ftp.py | 2 +-
.../providers/google/cloud/operators/bigquery.py | 83 ++--
airflow/providers/google/cloud/operators/gcs.py | 10 +-
.../google/cloud/operators/kubernetes_engine.py | 5 +-
airflow/providers/google/cloud/operators/pubsub.py | 102 ++---
.../google/cloud/transfers/adls_to_gcs.py | 10 +-
.../providers/google/cloud/transfers/gcs_to_gcs.py | 84 ++--
.../google/cloud/transfers/mssql_to_gcs.py | 18 +-
.../providers/microsoft/azure/operators/adls.py | 6 +-
.../azure/operators/container_instances.py | 46 +-
airflow/providers/sftp/operators/sftp.py | 2 +-
airflow/sensors/weekday.py | 17 +-
airflow/utils/email.py | 2 +-
airflow/utils/helpers.py | 2 +-
airflow/utils/types.py | 1 +
airflow/www/extensions/init_appbuilder.py | 21 +-
dev/README_RELEASE_AIRFLOW.md | 46 +-
dev/README_RELEASE_PROVIDER_PACKAGES.md | 180 +++++---
.../src/airflow_breeze/commands/common_options.py | 11 +-
.../common_package_installation_options.py | 5 +-
.../airflow_breeze/commands/developer_commands.py | 7 +-
.../commands/developer_commands_config.py | 1 +
.../commands/release_management_commands.py | 115 ++++-
.../commands/release_management_commands_config.py | 5 +-
dev/breeze/src/airflow_breeze/global_constants.py | 1 +
.../src/airflow_breeze/params/shell_params.py | 7 +
.../prepare_providers/provider_packages.py | 43 +-
.../provider_issue_TEMPLATE.md.jinja2 | 10 +-
.../airflow_breeze/utils/docker_command_utils.py | 35 +-
.../src/airflow_breeze/utils/docs_publisher.py | 101 +++++
.../src/airflow_breeze/utils/md5_build_check.py | 13 +-
dev/breeze/src/airflow_breeze/utils/packages.py | 24 +-
dev/breeze/src/airflow_breeze/utils/path_utils.py | 1 +
.../airflow_breeze/utils/publish_docs_builder.py | 297 ------------
.../src/airflow_breeze/utils/selective_checks.py | 58 +--
dev/breeze/tests/test_selective_checks.py | 47 ++
dev/mypy/plugin/outputs.py | 1 +
...agram_fab_auth_manager_airflow_architecture.png | Bin 0 -> 81735 bytes
...iagram_auth_manager_airflow_architecture.md5sum | 1 +
.../diagram_auth_manager_airflow_architecture.png | Bin 0 -> 54220 bytes
.../diagram_auth_manager_airflow_architecture.py | 73 +++
.../img/diagram_basic_airflow_architecture.md5sum | 1 +
.../img/diagram_basic_airflow_architecture.py | 77 ++++
...agram_dag_processor_airflow_architecture.md5sum | 1 +
.../diagram_dag_processor_airflow_architecture.py | 84 ++++
...am_fab_auth_manager_airflow_architecture.md5sum | 1 +
...agram_fab_auth_manager_airflow_architecture.png | Bin 0 -> 49545 bytes
...iagram_fab_auth_manager_airflow_architecture.py | 74 +++
.../diagrams/python_multiprocess_logo.png | Bin
docs/exts/docs_build/docs_builder.py | 34 --
generated/provider_dependencies.json | 2 +-
generated/provider_metadata.json | 500 ++++++++++++---------
images/breeze/output_build-docs.svg | 54 ++-
images/breeze/output_build-docs.txt | 2 +-
...tput_release-management_add-back-references.svg | 26 +-
...tput_release-management_add-back-references.txt | 2 +-
...management_generate-issue-content-providers.svg | 18 +-
...management_generate-issue-content-providers.txt | 2 +-
...elease-management_install-provider-packages.svg | 92 ++--
...elease-management_install-provider-packages.txt | 2 +-
...e-management_prepare-provider-documentation.svg | 54 +--
...e-management_prepare-provider-documentation.txt | 2 +-
...elease-management_prepare-provider-packages.svg | 36 +-
...elease-management_prepare-provider-packages.txt | 2 +-
.../output_release-management_publish-docs.svg | 56 +--
.../output_release-management_publish-docs.txt | 2 +-
...release-management_verify-provider-packages.svg | 74 ++-
...release-management_verify-provider-packages.txt | 2 +-
images/breeze/output_shell.svg | 104 +++--
images/breeze/output_shell.txt | 2 +-
images/breeze/output_start-airflow.svg | 82 ++--
images/breeze/output_start-airflow.txt | 2 +-
pyproject.toml | 3 +
scripts/ci/pre_commit/common_precommit_utils.py | 2 +-
.../pre_commit_generate_airflow_diagrams.py | 121 +----
.../pre_commit_update_providers_dependencies.py | 8 +-
scripts/docker/install_os_dependencies.sh | 2 +-
.../in_container/install_airflow_and_providers.py | 7 +-
tests/conftest.py | 6 +-
tests/test_utils/providers.py | 2 +-
tests/www/views/test_views_tasks.py | 1 +
110 files changed, 1858 insertions(+), 1439 deletions(-)
create mode 100644 dev/breeze/src/airflow_breeze/utils/docs_publisher.py
delete mode 100644 dev/breeze/src/airflow_breeze/utils/publish_docs_builder.py
create mode 100644
docs/apache-airflow-providers-fab/img/diagram_fab_auth_manager_airflow_architecture.png
create mode 100644
docs/apache-airflow/img/diagram_auth_manager_airflow_architecture.md5sum
create mode 100644
docs/apache-airflow/img/diagram_auth_manager_airflow_architecture.png
create mode 100644
docs/apache-airflow/img/diagram_auth_manager_airflow_architecture.py
create mode 100644
docs/apache-airflow/img/diagram_basic_airflow_architecture.md5sum
create mode 100644
docs/apache-airflow/img/diagram_basic_airflow_architecture.py
create mode 100644
docs/apache-airflow/img/diagram_dag_processor_airflow_architecture.md5sum
create mode 100644
docs/apache-airflow/img/diagram_dag_processor_airflow_architecture.py
create mode 100644
docs/apache-airflow/img/diagram_fab_auth_manager_airflow_architecture.md5sum
create mode 100644
docs/apache-airflow/img/diagram_fab_auth_manager_airflow_architecture.png
create mode 100644
docs/apache-airflow/img/diagram_fab_auth_manager_airflow_architecture.py
rename {images => docs}/diagrams/python_multiprocess_logo.png (100%)
