This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch v2-8-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 0b9f95583c Fix broken regex for allowed_deserialization_classes
(#36147)
new 320fa6ce3b Upgrade mypy to 1.8.0 (#36428)
new 3329244ea6 Upgrade to just released `pip 24.0` (#37236)
new 0fce4117c8 Remove validate-operators-init from v2-* static check
branches (#37238)
new 7d61668c27 Trims leading `./` from filenames when repackaging
reproducible packages (#37253)
new 188b460861 Sign helm chart packages without dist/ prefix (#37260)
new a9b7feac8c Optimize CI builds for unimportant pyproject.toml changes
(#37305)
new ec4fb1aa08 Optimize CI jobs when for example only pre-commits change
in scripts (#37308)
new 14d3ea5e2a Make PRs changing pyproject.toml neutral for breeze tests
(#37314)
new 22ed844695 Limit universal-pathlib to < 0.2.0 (#37311)
new 0b34ea283f Ignore occasional GPG error exists when generating key
(#37325)
new 387012a810 Add better diagnostics when provider.yaml check fails
(#37322)
new 9ffdf7bcae Fix pyhive hive_pure_sasl extra name (#37323)
new db73802401 Optimize cachine installed packages in CI build (#37315)
new a5ad81411e Get rid of pytest-httpx as dependency (#37334)
new d1b4841376 Fix remote installation from git (#37340)
new 1ac461dedb Follow up after moving hatch_build.py to source root
(#37341)
new f3de8fb4ea Swtich to standard way of specifying package extra for
github URL (#37342)
new 2c94aa237e Add "devel-ci" extra with all possible dependencies to
wheel (#37345)
new 992752ff52 Trigger full cache rebuild with new EPOCH values (#37346)
new d7a3a799be Add celery and cncf.kubernetes to devel dependencies
(#37333)
new cc239cac5f Clarify docs around --package-filter flags in docs breeze
commands (#37354)
new 3a76a443c1 Improve speed of regular upgrades when dependencies change.
(#37360)
new eb00f003de Turn Pydantic into an optional dependency (#37320)
The 23 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.dockerignore | 3 +
.github/actions/build-prod-images/action.yml | 2 +-
.github/workflows/ci.yml | 104 +++++++++----
.pre-commit-config.yaml | 2 +-
Dockerfile | 24 ++-
Dockerfile.ci | 96 ++++++++----
INSTALL | 7 +-
airflow/models/dagrun.py | 3 +-
airflow/providers/MANAGING_PROVIDERS_LIFECYCLE.rst | 6 +-
airflow/providers/amazon/aws/hooks/base_aws.py | 2 +-
.../amazon/aws/utils/connection_wrapper.py | 5 +-
airflow/providers/apache/hdfs/sensors/hdfs.py | 2 +
airflow/providers/apache/hive/provider.yaml | 2 +-
airflow/providers/databricks/provider.yaml | 2 +-
.../triggers/cloud_storage_transfer_service.py | 8 +-
airflow/providers/http/hooks/http.py | 3 +-
airflow/providers/http/provider.yaml | 2 +-
airflow/providers/influxdb/provider.yaml | 2 +-
airflow/providers/papermill/hooks/kernel.py | 5 +-
airflow/providers_manager.py | 23 +++
airflow/serialization/pydantic/dag.py | 10 +-
airflow/serialization/pydantic/dag_run.py | 6 +-
airflow/serialization/pydantic/dataset.py | 2 +-
airflow/serialization/pydantic/job.py | 3 +-
airflow/serialization/pydantic/taskinstance.py | 13 +-
airflow/serialization/pydantic/tasklog.py | 2 +-
airflow/serialization/serialized_objects.py | 3 +-
airflow/utils/pydantic.py | 69 +++++++++
...ders.txt => airflow_pre_installed_providers.txt | 0
contributing-docs/07_local_virtualenv.rst | 2 +-
.../12_airflow_dependencies_and_extras.rst | 7 +-
contributing-docs/testing/unit_tests.rst | 2 -
dev/README_RELEASE_AIRFLOW.md | 6 +-
dev/README_RELEASE_HELM_CHART.md | 8 +-
dev/breeze/README.md | 2 +-
dev/breeze/doc/03_developer_tasks.rst | 10 +-
dev/breeze/doc/09_release_management_tasks.rst | 20 ++-
dev/breeze/doc/ci/02_images.md | 2 +-
dev/breeze/doc/images/output_build-docs.svg | 43 +++---
dev/breeze/doc/images/output_build-docs.txt | 2 +-
.../output_release-management_publish-docs.svg | 49 +++---
.../output_release-management_publish-docs.txt | 2 +-
.../images/output_sbom_update-sbom-information.svg | 50 +++---
.../images/output_sbom_update-sbom-information.txt | 2 +-
dev/breeze/doc/images/output_shell.svg | 46 +++---
dev/breeze/doc/images/output_shell.txt | 2 +-
dev/breeze/doc/images/output_testing_db-tests.svg | 68 +++++----
dev/breeze/doc/images/output_testing_db-tests.txt | 2 +-
.../doc/images/output_testing_non-db-tests.svg | 68 +++++----
.../doc/images/output_testing_non-db-tests.txt | 2 +-
dev/breeze/doc/images/output_testing_tests.svg | 68 +++++----
dev/breeze/doc/images/output_testing_tests.txt | 2 +-
dev/breeze/pyproject.toml | 1 +
.../src/airflow_breeze/commands/common_options.py | 9 ++
.../airflow_breeze/commands/developer_commands.py | 10 +-
.../commands/developer_commands_config.py | 3 +-
.../commands/release_management_commands.py | 8 +-
.../src/airflow_breeze/commands/sbom_commands.py | 5 +-
.../airflow_breeze/commands/testing_commands.py | 42 ++---
.../commands/testing_commands_config.py | 42 +++--
dev/breeze/src/airflow_breeze/global_constants.py | 4 +-
.../src/airflow_breeze/params/shell_params.py | 3 +
.../airflow_breeze/utils/docker_command_utils.py | 1 +
.../src/airflow_breeze/utils/reproducible.py | 2 +
.../src/airflow_breeze/utils/selective_checks.py | 138 +++++++++++++++--
dev/breeze/tests/test_selective_checks.py | 160 +++++++++++++++++--
dev/refresh_images.sh | 2 +-
docker_tests/test_prod_image.py | 5 +-
.../apache-airflow-providers-apache-hive/index.rst | 2 +-
docs/apache-airflow/extra-packages-ref.rst | 4 +-
docs/build_docs.py | 4 +-
docs/docker-stack/build-arg-ref.rst | 2 +-
generated/provider_dependencies.json | 8 +-
dev/hatch_build.py => hatch_build.py | 18 ++-
...iders.txt => prod_image_installed_providers.txt | 0
pyproject.toml | 49 ++++--
scripts/ci/docker-compose/devcontainer.env | 5 +-
scripts/ci/docker-compose/local.yml | 3 +
scripts/ci/install_breeze.sh | 2 +-
.../pre_commit_check_provider_yaml_files.py | 8 +-
.../pre_commit_sort_installed_providers.py | 5 +-
scripts/docker/common.sh | 2 +-
scripts/docker/entrypoint_ci.sh | 35 +++++
...install_airflow_dependencies_from_branch_tip.sh | 11 +-
tests/always/test_example_dags.py | 5 +
tests/api/common/test_airflow_health.py | 86 ++++++-----
.../endpoints/test_rpc_api_endpoint.py | 2 +
tests/api_internal/test_internal_api_call.py | 2 +
tests/cli/commands/test_info_command.py | 31 ++--
tests/conftest.py | 1 +
tests/core/test_configuration.py | 169 +++++++++++----------
tests/core/test_settings.py | 12 +-
tests/providers/openai/hooks/test_openai.py | 3 +
tests/providers/openai/operators/test_openai.py | 2 +
.../serialization/serializers/test_serializers.py | 41 ++---
tests/serialization/test_pydantic_models.py | 2 +
tests/serialization/test_serde.py | 8 +-
tests/serialization/test_serialized_objects.py | 1 +
.../example_cloud_storage_transfer_service_aws.py | 3 +-
99 files changed, 1250 insertions(+), 587 deletions(-)
create mode 100644 airflow/utils/pydantic.py
rename dev/airflow_pre_installed_providers.txt =>
airflow_pre_installed_providers.txt (100%)
rename dev/hatch_build.py => hatch_build.py (89%)
rename dev/prod_image_installed_providers.txt =>
prod_image_installed_providers.txt (100%)
