This is an automated email from the ASF dual-hosted git repository.
github-actions[bot] pushed a change to branch ci-upgrade-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 72d180da47e [main] CI: Upgrade important CI environment
add c6a077b0efe Serialise the workflows that publish shared state (#75996)
add 9e662c23fc0 Fix stale queued asset rows in scheduler cleanup and
readiness (#76002)
add 56b44decc8f Sync the session's copy with the DB for removed task
instances when scheduling (#75974)
add 1df83c5dff6 Type the ORM declarative base as a value of type Any
(#76025)
add 155560df668 Store and show the retry deadline; start retries with
empty run fields (#76027)
add 5af4c5bf12d Freeze the GC before the triggerer's forks so memory stays
flat (#76016)
add 5cc2413925a Honor Airflow logging levels in TypeScript SDK (#76005)
add acb2208f15f Let the ECS executor start tasks in parallel (#75907)
add 48435351c42 Pin the hardened base images to digests the CI has passed
on (#76023)
add a3a4f4f168e Stop bundling the ELK worker twice in the UI (#75864)
add ecb95734544 UI: Fix select filter pills staying open in Safari (#76013)
add 527f92e15ca Allow selecting task groups in the Grid view (#75856)
add d2e60aefea2 Retry GitHub calls that drop the connection in the Spot
interruption notices (#75829)
add 460f7a08bf8 Close fork CI pull requests that change jobs running in
gated runs (#75827)
new 4ceeb163a1f [main] CI: Upgrade important CI environment
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (72d180da47e)
\
N -- N -- N refs/heads/ci-upgrade-main (4ceeb163a1f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/actions/breeze/action.yml | 6 +
.github/workflows/ci-amd.yml | 15 +-
.github/workflows/ci-arm.yml | 10 +-
.github/workflows/mirror-hardened-base-images.yml | 84 ++-
.github/workflows/publish-docs-to-s3.yml | 74 ++-
.github/workflows/refresh-image-registry-cache.yml | 7 +-
.github/workflows/registry-backfill.yml | 6 +
.github/workflows/registry-build.yml | 9 +
.github/workflows/release-constraints.yml | 12 +-
.github/workflows/release_dockerhub_image.yml | 11 +-
.../scheduled-legacy-prod-image-canary.yml | 7 +-
.github/workflows/scheduled-upgrade-check-main.yml | 2 +
.../scheduled-upgrade-check-v3-4-test.yml | 2 +
.../update-constraints-on-push-stable.yml | 11 +-
.github/workflows/update-constraints-on-push.yml | 12 +-
.github/workflows/upgrade-check.yml | 78 ++-
.pre-commit-config.yaml | 2 +-
Dockerfile | 81 ++-
Dockerfile.ci | 75 ++-
airflow-core/docs/ui.rst | 5 +-
.../core_api/datamodels/task_instance_history.py | 4 +
.../core_api/datamodels/task_instances.py | 5 +
.../api_fastapi/core_api/datamodels/ui/grid.py | 1 +
.../api_fastapi/core_api/openapi/_private_ui.yaml | 14 +
.../core_api/openapi/v2-rest-api-generated.yaml | 16 +
.../airflow/api_fastapi/core_api/routes/ui/grid.py | 2 +
.../api_fastapi/core_api/services/ui/grid.py | 5 +
.../execution_api/routes/task_instances.py | 5 +-
airflow-core/src/airflow/assets/manager.py | 27 +-
.../src/airflow/cli/commands/triggerer_command.py | 9 +-
.../src/airflow/jobs/scheduler_job_runner.py | 332 +++++-----
.../src/airflow/jobs/triggerer_job_runner.py | 7 +
.../0142_3_4_0_unify_task_attempt_ownership.py | 3 +-
airflow-core/src/airflow/models/asset.py | 44 +-
airflow-core/src/airflow/models/base.py | 13 +-
airflow-core/src/airflow/models/dag.py | 13 +-
airflow-core/src/airflow/models/dagrun.py | 13 +-
airflow-core/src/airflow/models/taskinstance.py | 88 ++-
.../serialization/definitions/baseoperator.py | 2 +-
.../serialization/definitions/mappedoperator.py | 2 +-
.../ti_deps/deps/not_in_retry_period_dep.py | 6 +-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 38 ++
.../airflow/ui/openapi-gen/requests/types.gen.ts | 9 +
.../airflow/ui/public/i18n/locales/en/common.json | 5 +-
.../ui/src/components/FilterBar/FilterBar.test.tsx | 20 +
.../components/FilterBar/filters/LoopFilter.tsx | 17 +-
.../FilterBar/filters/RunStateFilter.tsx | 27 +-
.../components/FilterBar/filters/SelectFilter.tsx | 21 +-
.../ui/src/components/Graph/useGraphLayout.ts | 3 +-
.../ui/src/components/TaskInstanceTooltip.test.tsx | 46 +-
.../ui/src/components/TaskInstanceTooltip.tsx | 7 +
.../airflow/ui/src/layouts/Details/Grid/Grid.tsx | 12 +-
.../Details/Grid/GridSelectionActionBar.test.tsx | 69 ++
.../Details/Grid/GridSelectionActionBar.tsx | 25 +-
.../layouts/Details/Grid/TaskInstancesColumn.tsx | 11 +-
.../Grid/useGridSelectedTaskInstances.test.tsx | 44 +-
.../Details/Grid/useGridSelectedTaskInstances.ts | 22 +-
.../layouts/Details/Grid/useGridSelection.test.tsx | 83 ++-
.../src/layouts/Details/Grid/useGridSelection.ts | 82 ++-
.../ui/src/pages/TaskInstance/Details.test.tsx | 24 +
.../airflow/ui/src/pages/TaskInstance/Details.tsx | 8 +
.../src/airflow/ui/tests/e2e/pages/DagsPage.ts | 4 +-
.../core_api/routes/public/test_hitl.py | 1 +
.../core_api/routes/public/test_task_instances.py | 92 ++-
.../api_fastapi/core_api/routes/ui/test_grid.py | 25 +
.../versions/head/test_task_instances.py | 1 +
airflow-core/tests/unit/assets/test_manager.py | 4 +-
.../unit/cli/commands/test_triggerer_command.py | 27 +
airflow-core/tests/unit/jobs/test_scheduler_job.py | 257 ++++++--
airflow-core/tests/unit/jobs/test_triggerer_job.py | 24 +
airflow-core/tests/unit/models/test_dag.py | 45 ++
airflow-core/tests/unit/models/test_dagrun.py | 25 +
.../tests/unit/models/test_taskinstance.py | 64 +-
airflow-core/tests/unit/models/test_trigger.py | 4 +-
.../src/airflowctl/api/datamodels/generated.py | 14 +
dev/README_RELEASE_AIRFLOW.md | 51 +-
dev/breeze/doc/09_release_management_tasks.rst | 47 ++
dev/breeze/doc/ci/02_images.md | 2 +-
.../doc/ci/08_fork_ci_for_external_contributors.md | 23 +-
dev/breeze/doc/images/output_ci_upgrade.svg | 114 ++--
dev/breeze/doc/images/output_ci_upgrade.txt | 2 +-
...utput_release-management_publish-docs-to-s3.svg | 64 +-
...utput_release-management_publish-docs-to-s3.txt | 2 +-
.../output_setup_check-all-params-in-groups.svg | 24 +-
.../output_setup_check-all-params-in-groups.txt | 2 +-
.../output_setup_regenerate-command-images.svg | 4 +-
.../output_setup_regenerate-command-images.txt | 2 +-
dev/breeze/doc/images/output_workflow-run.svg | 34 +-
dev/breeze/doc/images/output_workflow-run.txt | 2 +-
.../output_workflow-run_mirror-base-images.svg | 111 ++++
.../output_workflow-run_mirror-base-images.txt | 1 +
.../images/output_workflow-run_upgrade-check.svg | 116 ++++
.../images/output_workflow-run_upgrade-check.txt | 1 +
.../src/airflow_breeze/commands/ci_commands.py | 119 +++-
.../airflow_breeze/commands/ci_commands_config.py | 2 +
.../commands/release_management_commands.py | 124 +++-
.../commands/release_management_commands_config.py | 2 +
.../airflow_breeze/commands/workflow_commands.py | 72 ++-
.../commands/workflow_commands_config.py | 24 +-
.../files/hardened_python_image_digests.json | 10 +
.../files/legacy_python_versions.json | 6 +
dev/breeze/src/airflow_breeze/global_constants.py | 38 +-
.../src/airflow_breeze/params/build_prod_params.py | 11 +-
.../src/airflow_breeze/utils/fork_ci_reconcile.py | 135 +++-
.../src/airflow_breeze/utils/gh_workflow_utils.py | 42 ++
.../src/airflow_breeze/utils/publish_docs_to_s3.py | 6 +-
dev/breeze/tests/test_build_prod_params.py | 44 +-
dev/breeze/tests/test_ci_upgrade.py | 100 +++
dev/breeze/tests/test_fork_ci_reconcile.py | 134 +++-
dev/breeze/tests/test_gh_workflow_utils.py | 54 ++
dev/breeze/tests/test_mirror_base_images.py | 142 ++++-
dev/breeze/tests/test_publish_docs_to_s3.py | 25 +
.../tests/test_release_management_commands.py | 70 +++
dev/breeze/tests/test_workflow_commands.py | 57 ++
docker-stack-docs/build-arg-ref.rst | 26 +-
docker-stack-docs/build.rst | 21 +-
.../customizing/add-build-essential-custom.sh | 3 +-
.../docker-examples/customizing/custom-sources.sh | 3 +-
.../customizing/pypi-dev-runtime-deps.sh | 3 +-
.../customizing/pypi-extras-and-deps.sh | 3 +-
.../customizing/pypi-selected-version.sh | 3 +-
.../restricted/restricted_environments.sh | 3 +-
.../test_examples_of_prod_image_building.py | 2 +
providers/amazon/docs/executors/ecs-executor.rst | 4 +
providers/amazon/provider.yaml | 9 +
.../amazon/aws/executors/ecs/ecs_executor.py | 230 +++++--
.../providers/amazon/aws/executors/ecs/utils.py | 3 +
.../airflow/providers/amazon/get_provider_info.py | 7 +
.../amazon/aws/executors/ecs/test_ecs_executor.py | 265 +++++++-
scripts/ci/prek/check_ci_workflows_in_sync.py | 5 +-
scripts/ci/prek/upgrade_important_versions.py | 141 ++++-
scripts/ci/spot_interruptions.py | 5 +-
scripts/docker/install_os_dependencies.sh | 62 +-
scripts/docker/install_postgres.sh | 6 +
.../ci/prek/test_upgrade_important_versions.py | 153 +++++
scripts/tests/ci/test_spot_interruptions.py | 36 +-
.../observability/metrics/metrics_template.yaml | 6 +
ts-sdk/src/coordinator/log-channel.ts | 94 ++-
ts-sdk/tests/coordinator/log-channel.test.ts | 173 ++++++
uv.lock | 692 +++++++++------------
140 files changed, 4900 insertions(+), 1157 deletions(-)
create mode 100644
airflow-core/src/airflow/ui/src/layouts/Details/Grid/GridSelectionActionBar.test.tsx
create mode 100644
dev/breeze/doc/images/output_workflow-run_mirror-base-images.svg
create mode 100644
dev/breeze/doc/images/output_workflow-run_mirror-base-images.txt
create mode 100644 dev/breeze/doc/images/output_workflow-run_upgrade-check.svg
create mode 100644 dev/breeze/doc/images/output_workflow-run_upgrade-check.txt
create mode 100644
dev/breeze/src/airflow_breeze/files/hardened_python_image_digests.json
create mode 100644
dev/breeze/src/airflow_breeze/files/legacy_python_versions.json
