This is an automated email from the ASF dual-hosted git repository.
vatsrahul1001 pushed a change to branch backport-8693c08-v3-4-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 4d016188e1e [v3-4-test] Retry fork CI job listings in smaller pages
(#76327)
omit be83ebbbf86 [v3-4-test] Skip allowlisted non-PEP 440 docs versions
when publishing docs to S3 (#76020) (#76343)
omit 01fee528881 [v3-4-test] UI: Keep Dag card columns aligned across cards
(#76004) (#76219)
omit 81614a039ff [v3-4-test] Return 404 when a DagRun disappears during
task API writes (#72907) (#76599)
omit 979904ed6a4 [v3-4-test] Set the TypeScript SDK version to 1.0.0-rc1
(#76594)
omit b7abe16731b [v3-4-test] UI: Fix select filter pills staying open in
Safari (#76013) (#76589)
omit dac5d28c8e4 [v3-4-test] Hold back only build-info changes in fork CI
and stop drafting them (#76282) (#76394)
omit 499f3b06492 [v3-4-test] Keep the language SDKs marked experimental in
the docs (#76584)
omit c81fb5c8681 [v3-4-test] Add script to remove constraints for
unsupported Python versions (#75333) (#76405)
omit 2ef2c391642 [v3-4-test] Build only required prek hook environments in
CI jobs on a cache miss (#76111) (#76256)
omit 818f86b0232 [v3-4-test] Keep extra cookies set by a route in
JWTRefreshMiddleware (#75869)
omit ea9416d04c4 Stop labelling fork CI PRs that change CI files for
workflow approval (#76289) (#76582)
omit 3e7f5c8a7cd [v3-4-test] Release the Java SDK 1.0.0 and pin its schema
URL to the published docs site (#75944) (#76577)
omit a75e5b105fa [v3-4-test] Bump TypeScript SDK to 1.0.0 (#76578)
omit e4e96516c32 [v3-4-test] Catch lazy timetable errors when starting
queued runs (#76288) (#76292)
omit ad1dc8eafa6 [v3-4-test] Add `partition_key` to the `DagRun Finished`
log line (#76557) (#76564)
omit 54d3fbc26e4 [v3-4-test] Make `JWTRefreshMiddleware` extensible via
`BaseAuthManager.get_jwt_refresh_middleware()` (#75868)
omit 1b9eb2bb179 [v3-4-test] Preserve task instance bulk selections across
pages (#75905) (#75983)
omit b4236dab7d1 [v3-4-test] Fix duplicated asset events when
name_prefix_pattern matches all (#74816) (#76570)
omit 5a6f07f36d2 [v3-4-test] Apply note before state in bulk Dag run update
so listeners see it (#74890) (#76523)
omit 24d904c3667 [v3-4-test] Lower severity of handled XCom misses (#73198)
(#76494)
omit d28fcffcb44 [v3-4-test] Skip log accumulator disk spill when reading
finished task logs (#70671) (#75956)
omit 76839662c3e [v3-4-test] UI: Defer React plugin compatibility runtime
(#75083) (#76548)
omit 465e0b8f206 [v3-4-test] Report failing fork job statuses only when the
failure persists (#76185) (#76396)
omit 89eebb95fb9 [v3-4-test] Add code owners for the cncf.kubernetes
provider (#76371) (#76383)
omit 9d71c0c1d52 [v3-4-test] Remove machine-global pnpm config causing
.pnpm-store dir to be created in places (#76498) (#76501)
omit d63fa3aaa1c [v3-4-test] Import TriggerRule from airflow.sdk in docs
examples (#76522) (#76526)
omit a264c38fdd6 [v3-4-test] Fix scheduler memory spike when a Dag run has
a large conf (#73907) (#76252)
omit 7502772a7d5 [v3-4-test] Restore default ELK node placement in Graph
view (#76488) (#76492)
omit c2c1d45aa49 [v3-4-test] Fix async engine datetimes being shifted on
non-UTC MySQL servers (#76505) (#76517)
omit adb86572b95 [v3-4-test] CI: Upgrade important CI environment
omit 689502c99bc [v3-4-test] Install apt-utils matching the image's apt on
hardened images (#76484) (#76485)
omit 21716d101d6 [v3-4-test] CI: Upgrade important CI environment
omit 03b0d52f7fa UI: Label the Dag bundle file table as Parsed Files and
say what it lists (#76462) (#76471)
omit 18a6d2daf0f Let asset watchers write asset state over the Execution
API (#76376) (#76469)
omit 7d1fc46e0da [v3-4-test] Keep mapped tasks when clearing with run on
latest version (#76420) (#76468)
omit 1c98dfa7fca [v3-4-test] Load Java Dags from a bundle path that holds a
colon (#76432) (#76459)
omit 3db206056b5 [v3-4-test] UI: Fix task groups not expanding when
localStorage is full (#76302) (#76452)
omit 6e4c51f99ed [v3-4-test] Document how to create a TypeScript SDK
project (#76374) (#76449)
omit da26242b719 [v3-4-test] UI: Complete the Italian translation (#76464)
omit 6255c639377 Update French (fr) UI translations to 100% coverage
(#76461)
omit 4d2f5e8cb92 [v3-4-test] UI: Complete the Spanish (es) translation
(#76087) (#76465)
omit 0c031565d85 [v3-4-test] Keep the audit log off the API server event
loop (#76416) (#76431)
omit 2cbd7b0b8ec Let non task callers set and delete variables over
execution API (#76375) (#76436)
omit c6cb20ff2ef [v3-4-test] Describe where the dependency upgrade summary
runs now (#76439) (#76454)
omit f2840d11795 [v3-4-test] Run the dependency upgrade summary beside the
tests instead of after them (#76251) (#76438)
omit 7746477b52f Snowflake, Databricks: emit query lineage via OpenLineage
public API (#73655) (#76450)
omit 6ccb1b96ca5 Upgrade happy-dom to 21.0.4 in the simple auth manager UI
(#76447)
omit eb025d365a4 Bump v3-4-test UI dependencies and upgrade happy-dom to 21
(#76441)
omit b93a97912a5 [v3-4-test] Add screenshots and a review loop example to
the task loops docs (#76435) (#76448)
omit 42f7a251c9f Note that the API server uses a second database connection
pool (#76430) (#76433)
omit aae28371675 [v3-4-test] Note that the API server uses a second
database connection pool (#76430) (#76434)
omit a17e4c086db [v3-4-test] UI: Complete and fix Polish translations
(#76429)
omit e63e6bb5244 [v3-4-test] Fix retry policy docs and the example Dag's
`ConnectionError` rules (#76313) (#76406)
omit 036ee4ffa51 [v3-4-test] Complete the missing zh-TW UI translations
(#76398) (#76401)
omit 86808ca52c9 [v3-4-test] Document the Dag Versions comparison tab in
the UI overview (#76387) (#76390)
omit d98fca04d3f [v3-4-test] Inline the masked Variable merge and drop
unused merge depth args (#76306) (#76378)
omit 0de66c7997e [v3-4-test] Keep masked Variable values when saving an
edited Variable (#76012) (#76308)
add a7bfc965e3d [v3-4-test] Document the Dag Versions comparison tab in
the UI overview (#76387) (#76390)
add af005970c1f [v3-4-test] Complete the missing zh-TW UI translations
(#76398) (#76401)
add 6368ffc9bed [v3-4-test] Fix retry policy docs and the example Dag's
`ConnectionError` rules (#76313) (#76406)
add ffd4bad585f [v3-4-test] UI: Complete and fix Polish translations
(#76429)
add 9e31d48c5af [v3-4-test] Note that the API server uses a second
database connection pool (#76430) (#76434)
add 1b7e928ffc1 [v3-4-test] Add screenshots and a review loop example to
the task loops docs (#76435) (#76448)
add 60e49df377c Bump v3-4-test UI dependencies and upgrade happy-dom to 21
(#76441)
add 019efa0e7a8 Upgrade happy-dom to 21.0.4 in the simple auth manager UI
(#76447)
add be56eb9f274 Snowflake, Databricks: emit query lineage via OpenLineage
public API (#73655) (#76450)
add 782be679e49 [v3-4-test] Run the dependency upgrade summary beside the
tests instead of after them (#76251) (#76438)
add ed25b2382e6 [v3-4-test] Describe where the dependency upgrade summary
runs now (#76439) (#76454)
add b811f957197 Let non task callers set and delete variables over
execution API (#76375) (#76436)
add 8d38cdfd7ad [v3-4-test] Keep the audit log off the API server event
loop (#76416) (#76431)
add 1754d747ca4 [v3-4-test] UI: Complete the Spanish (es) translation
(#76087) (#76465)
add 0ece5c6f788 Update French (fr) UI translations to 100% coverage
(#76461)
add 837f4b0442c [v3-4-test] UI: Complete the Italian translation (#76464)
add 21321fbb4e3 [v3-4-test] Document how to create a TypeScript SDK
project (#76374) (#76449)
add d6d3755a1bc [v3-4-test] UI: Fix task groups not expanding when
localStorage is full (#76302) (#76452)
add cf7044be922 [v3-4-test] Load Java Dags from a bundle path that holds a
colon (#76432) (#76459)
add cc184d567a0 [v3-4-test] Keep mapped tasks when clearing with run on
latest version (#76420) (#76468)
add 244f87e99f6 Let asset watchers write asset state over the Execution
API (#76376) (#76469)
add 9286d067025 UI: Label the Dag bundle file table as Parsed Files and
say what it lists (#76462) (#76471)
add 21efe3ecbc8 [v3-4-test] CI: Upgrade important CI environment
add 2ef333d474d [v3-4-test] Install apt-utils matching the image's apt on
hardened images (#76484) (#76485)
add 8953c35cc5a [v3-4-test] CI: Upgrade important CI environment
add dc2a17798b1 [v3-4-test] Fix async engine datetimes being shifted on
non-UTC MySQL servers (#76505) (#76517)
add 619a787ac81 Add release notes for 3.4.0rc3
add 93c883b7463 [v3-4-test] Keep masked Variable values when saving an
edited Variable (#76012) (#76308)
add e355086ae15 [v3-4-test] Inline the masked Variable merge and drop
unused merge depth args (#76306) (#76378)
add 13b337abd5e Note that the API server uses a second database connection
pool (#76430) (#76433)
add ee2130aa10a [v3-4-test] Restore default ELK node placement in Graph
view (#76488) (#76492)
add 3cf7ff1292e [v3-4-test] Fix scheduler memory spike when a Dag run has
a large conf (#73907) (#76252)
add 701ad953374 [v3-4-test] Import TriggerRule from airflow.sdk in docs
examples (#76522) (#76526)
add 6f7b1b05cef [v3-4-test] Remove machine-global pnpm config causing
.pnpm-store dir to be created in places (#76498) (#76501)
add ac2df31ce3c [v3-4-test] Add code owners for the cncf.kubernetes
provider (#76371) (#76383)
add 86ebacc084f [v3-4-test] Report failing fork job statuses only when the
failure persists (#76185) (#76396)
add 3d7b3f5aa61 [v3-4-test] UI: Defer React plugin compatibility runtime
(#75083) (#76548)
add 0391f1672e4 [v3-4-test] Skip log accumulator disk spill when reading
finished task logs (#70671) (#75956)
add f0c2dcd0406 [v3-4-test] Lower severity of handled XCom misses (#73198)
(#76494)
add fb3d0805244 [v3-4-test] Apply note before state in bulk Dag run update
so listeners see it (#74890) (#76523)
add 42e1aa8a4df [v3-4-test] Fix duplicated asset events when
name_prefix_pattern matches all (#74816) (#76570)
add d80fd5ec2dd [v3-4-test] Preserve task instance bulk selections across
pages (#75905) (#75983)
add ac324964dea [v3-4-test] Make `JWTRefreshMiddleware` extensible via
`BaseAuthManager.get_jwt_refresh_middleware()` (#75868)
add 1dcc71f39b4 [v3-4-test] Add `partition_key` to the `DagRun Finished`
log line (#76557) (#76564)
add 53b44811166 [v3-4-test] Catch lazy timetable errors when starting
queued runs (#76288) (#76292)
add b4c51feed18 [v3-4-test] Bump TypeScript SDK to 1.0.0 (#76578)
add b9bdb4c1835 [v3-4-test] Release the Java SDK 1.0.0 and pin its schema
URL to the published docs site (#75944) (#76577)
add 7a48d57b1cf Stop labelling fork CI PRs that change CI files for
workflow approval (#76289) (#76582)
add c2adc83d51b [v3-4-test] Keep extra cookies set by a route in
JWTRefreshMiddleware (#75869)
add 4458b6b73fc [v3-4-test] Build only required prek hook environments in
CI jobs on a cache miss (#76111) (#76256)
add 6d21a2c9ac0 [v3-4-test] Add script to remove constraints for
unsupported Python versions (#75333) (#76405)
add 0ba536620ea [v3-4-test] Keep the language SDKs marked experimental in
the docs (#76584)
add b017aa02bbb [v3-4-test] Hold back only build-info changes in fork CI
and stop drafting them (#76282) (#76394)
add 5a1e913af12 [v3-4-test] UI: Fix select filter pills staying open in
Safari (#76013) (#76589)
add d75f608cba4 [v3-4-test] Set the TypeScript SDK version to 1.0.0-rc1
(#76594)
add 87ac7048a02 [v3-4-test] Return 404 when a DagRun disappears during
task API writes (#72907) (#76599)
add 503d2b47cd9 [v3-4-test] UI: Keep Dag card columns aligned across cards
(#76004) (#76219)
add 46076f68049 [v3-4-test] Skip allowlisted non-PEP 440 docs versions
when publishing docs to S3 (#76020) (#76343)
add 1bd6b415097 Bump the github-actions-updates group across 1 directory
with 6 updates (#76426)
add 4169e73bd70 [v3-4-test] Let a final release override the
pending-provider-candidate guard (#76592) (#76597)
add 34b46fa09a0 Bump the 3-4-ui-plugin-template-package-updates group
across 1 directory with 7 updates (#76607)
add 001ecc38ee2 [v3-4-test] Check that the fork's GitHub Actions can run
in breeze ci audit (#76136) (#76307)
add 45f38c1ef6c [v3-4-test] Fix providers release guide steps that use
wrong dates or labels (#76625) (#76630)
add 74f6424ad4c Bump the 3-4-core-ui-package-updates group across 1
directory with 13 updates (#76620)
add 3ca40734d62 Bump the 3-4-auth-ui-package-updates group across 1
directory with 9 updates (#76617)
add b1942314ba3 Bump filelock in /dev/breeze in the
3-4-uv-dependency-updates group (#76612)
add aa966e3c367 Bump the 3-4-registry-package-updates group across 1
directory with 2 updates (#76611)
add 6d99bc7ac70 [v3-4-test] Bump happy-dom from 20.14.6 to 21.0.4 in
/dev/react-plugin-tools/react_plugin_template (#76098) (#76657)
add 776f9d8e521 [v3-4-test] Use get_github_repo to check the release
candidate remote (#76641) (#76654)
add f0d411ede72 [v3-4-test] Fix tag-providers not finding a push remote
without .git suffix (#76624) (#76660)
add 57fa401dbfe [v3-4-test] Add missing zh-CN UI translations (#74294)
(#76664)
add fd5a23d5b4a [v3-4-test] Add new Translation Owner in Ko (#76673)
(#76679)
add 1547f1f131b [v3-4-test] Explain a BASE_IMAGE without Python in
hardened image builds (#76645) (#76659)
add ebc5d45bdf8 [v3-4-test] Build CI and release images on pinned
OS-dependencies images (#76225) (#76642)
add 2bfd2efa78c [v3-4-test] Inline the GPG keys into the PROD Dockerfile
(#76644) (#76717)
add 9c024435d2c [v3-4-test] Retry fork CI job listings in smaller pages
(#76327)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4d016188e1e)
\
N -- N -- N refs/heads/backport-8693c08-v3-4-test (9c024435d2c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../prepare-providers-documentation/SKILL.md | 5 +-
.github/CODEOWNERS | 2 +-
.github/workflows/ci-amd.yml | 7 +-
.github/workflows/ci-arm.yml | 7 +-
.github/workflows/ci-image-build.yml | 8 +
.github/workflows/ci-notification.yml | 2 +-
.github/workflows/codeql-analysis.yml | 6 +-
.github/workflows/java-sdk-dependency-security.yml | 6 +-
.github/workflows/mirror-hardened-base-images.yml | 173 ++++-
.github/workflows/notify-uv-lock-conflicts.yml | 2 +-
.github/workflows/prod-image-build.yml | 8 +
.github/workflows/registry-tests.yml | 2 +-
.github/workflows/release-constraints.yml | 16 +-
.../scheduled-verify-release-calendar.yml | 2 +-
.github/workflows/upgrade-check.yml | 5 +-
Dockerfile | 362 ++++++++--
Dockerfile.ci | 118 +++-
RELEASE_NOTES.rst | 34 +-
airflow-core/newsfragments/76234.bugfix.rst | 1 -
airflow-core/newsfragments/76430.significant.rst | 11 -
.../auth/managers/simple/ui/package.json | 18 +-
.../auth/managers/simple/ui/pnpm-lock.yaml | 374 +++++-----
airflow-core/src/airflow/ui/package.json | 26 +-
airflow-core/src/airflow/ui/pnpm-lock.yaml | 238 +++----
.../ui/public/i18n/locales/zh-CN/admin.json | 1 +
.../ui/public/i18n/locales/zh-CN/assets.json | 1 +
.../ui/public/i18n/locales/zh-CN/common.json | 16 +-
.../ui/public/i18n/locales/zh-CN/components.json | 16 +-
.../airflow/ui/public/i18n/locales/zh-CN/dag.json | 56 ++
.../airflow/ui/public/i18n/locales/zh-CN/dags.json | 9 +
contributing-docs/18_contribution_workflow.rst | 11 +
dev/README_RELEASE_AIRFLOW.md | 16 +
dev/README_RELEASE_PROVIDERS.md | 28 +-
dev/breeze/doc/08_ci_tasks.rst | 6 +-
dev/breeze/doc/09_release_management_tasks.rst | 72 ++
.../doc/adr/0021-pin-os-dependencies-images.md | 123 ++++
dev/breeze/doc/ci/02_images.md | 46 ++
dev/breeze/doc/ci/04_selective_checks.md | 12 +-
.../doc/ci/08_fork_ci_for_external_contributors.md | 26 +-
dev/breeze/doc/images/output_ci-image_build.svg | 178 +++--
dev/breeze/doc/images/output_ci-image_build.txt | 2 +-
dev/breeze/doc/images/output_prod-image_build.svg | 238 ++++---
dev/breeze/doc/images/output_prod-image_build.txt | 2 +-
.../doc/images/output_release-management.svg | 48 +-
.../doc/images/output_release-management.txt | 2 +-
...put_release-management_build-os-deps-images.svg | 146 ++++
...put_release-management_build-os-deps-images.txt | 1 +
...t_release-management_publish-os-deps-images.svg | 136 ++++
...t_release-management_publish-os-deps-images.txt | 1 +
.../output_setup_check-all-params-in-groups.svg | 66 +-
.../output_setup_check-all-params-in-groups.txt | 2 +-
.../output_setup_regenerate-command-images.svg | 76 +-
.../output_setup_regenerate-command-images.txt | 2 +-
.../output_workflow-run_mirror-base-images.svg | 30 +-
.../output_workflow-run_mirror-base-images.txt | 2 +-
.../output_workflow-run_release-constraints.svg | 52 +-
.../output_workflow-run_release-constraints.txt | 2 +-
.../src/airflow_breeze/commands/ci_commands.py | 8 +-
.../airflow_breeze/commands/ci_image_commands.py | 4 +
.../commands/ci_image_commands_config.py | 1 +
.../commands/common_image_options.py | 8 +
.../commands/production_image_commands.py | 4 +
.../commands/production_image_commands_config.py | 1 +
.../commands/release_candidate_command.py | 16 +-
.../src/airflow_breeze/commands/release_command.py | 37 +-
.../commands/release_management_commands.py | 349 ++++++++-
.../commands/release_management_commands_config.py | 23 +
.../airflow_breeze/commands/workflow_commands.py | 29 +-
.../commands/workflow_commands_config.py | 2 +
.../files/hardened_os_deps_image_digests.json | 1 +
dev/breeze/src/airflow_breeze/global_constants.py | 65 ++
.../src/airflow_breeze/params/build_ci_params.py | 2 +
.../src/airflow_breeze/params/build_prod_params.py | 26 +
.../airflow_breeze/params/common_build_params.py | 37 +
dev/breeze/src/airflow_breeze/utils/ci_audit.py | 177 ++++-
.../src/airflow_breeze/utils/gh_workflow_utils.py | 8 +-
.../airflow_breeze/utils/release_constraints.py | 67 +-
.../src/airflow_breeze/utils/selective_checks.py | 18 +
dev/breeze/tests/test_ci_audit.py | 236 ++++++-
dev/breeze/tests/test_ci_upgrade.py | 1 +
dev/breeze/tests/test_gh_workflow_utils.py | 6 +-
dev/breeze/tests/test_mirror_base_images.py | 36 +-
dev/breeze/tests/test_os_deps_images.py | 782 +++++++++++++++++++++
dev/breeze/tests/test_release_candidate_command.py | 22 +
dev/breeze/tests/test_release_command.py | 77 +-
dev/breeze/tests/test_release_constraints.py | 65 ++
.../tests/test_release_management_commands.py | 37 +-
dev/breeze/tests/test_selective_checks.py | 50 ++
dev/breeze/tests/test_workflow_commands.py | 40 +-
dev/breeze/uv.lock | 6 +-
.../react_plugin_template/package.json | 16 +-
.../react_plugin_template/pnpm-lock.yaml | 422 +++++------
docker-stack-docs/build-arg-ref.rst | 17 +
docker-stack-docs/build.rst | 12 +
registry/package.json | 4 +-
registry/pnpm-lock.yaml | 76 +-
reproducible_build.yaml | 4 +-
scripts/ci/prek/inline_scripts_in_docker.py | 12 +
scripts/ci/prek/upgrade_important_versions.py | 103 ++-
scripts/docker/install_os_dependencies.sh | 73 ++
.../ci/prek/test_upgrade_important_versions.py | 114 ++-
101 files changed, 4881 insertions(+), 1071 deletions(-)
delete mode 100644 airflow-core/newsfragments/76234.bugfix.rst
delete mode 100644 airflow-core/newsfragments/76430.significant.rst
create mode 100644 dev/breeze/doc/adr/0021-pin-os-dependencies-images.md
create mode 100644
dev/breeze/doc/images/output_release-management_build-os-deps-images.svg
create mode 100644
dev/breeze/doc/images/output_release-management_build-os-deps-images.txt
create mode 100644
dev/breeze/doc/images/output_release-management_publish-os-deps-images.svg
create mode 100644
dev/breeze/doc/images/output_release-management_publish-os-deps-images.txt
create mode 100644
dev/breeze/src/airflow_breeze/files/hardened_os_deps_image_digests.json
create mode 100644 dev/breeze/tests/test_os_deps_images.py
