This is an automated email from the ASF dual-hosted git repository.
ephraimbuddy pushed a change to branch dag-processor-source-consistency
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard bffe26cb734 Avoid parsing stalls while a bundle refresh waits for
imports
discard 722db9c78c2 Keep Dag parsing results aligned with refreshed bundle
sources
omit 6bb9d0c0d01 Distinguish invalid Dag access control from FAB backend
failures
add a87c6ddb52a Allow downgrading past the TI ownership migration when
data is present (#74407)
add 937dfb6894d Fix CI image build after mprocs was renamed to dekit
(#74715)
add 0a66ba0c468 Update my CODEOWNERS entries to focus on AI providers and
the registry (#74795)
add cf839aca896 Fix JWT token not refreshed when token expires mid-request
(#68499)
add 5a6ab34fd51 Fix flaky in-process Execution API transport lifecycle
test on MySQL (#74785)
add 868d791a17c Add an OpenAI Agents SDK adapter for `common.ai` toolsets
(#74767)
add 6cf83327d46 UI: Drop the loading spinner for base React plugins
(#74762)
add 04572ba9500 Run the OpenAI Agents adapter tests in the agent framework
CI job (#74768)
add 7a55044c0fa Re-enable backporting to v3-4-test for the 3.4.0 RC phase
(#74798)
add bb140716849 Re lock uv.lock after new provider versions got stampped.
(#74799)
add c65451f5397 Walk through the reviewer's side of Common AI approval
gates (#74737)
add 5ab698987f9 Allow durable agent execution with a `CodeMode` capability
(#74735)
add bbf2c5b1c47 Fix Lang-SDK decoder typing for pydantic 2.14 TypeForm
signature (#74628)
add e2237bfc7ee UI: Guard the remaining RadioCardRoot values instead of
casting (#74743)
add 7c2c9226e0f Let retry policies reschedule a task without using a retry
(#74719)
add fc12cb2ca8f Document progressive tool disclosure for Common AI
toolsets (#74736)
add 098d0174731 Report a Dag whose timetable fails to load as an import
error (#74709)
add 61f1d4b85e1 Resolve a trigger's XCom requests as its deferred task
instance (#74772)
add 637b741f1a6 Pass Dag runs directly to Deadline references (#70714)
add 53c83b952b1 Record OpenAI Agents SDK traces as the Airflow task's
OpenTelemetry spans (#74769)
add 03f45f3ad51 Update the DMS replication_task_modified waiter states
(#74522)
add 62641fa9ac0 Fix CLI --bundle-name finding no Dags in Git bundles
(#73377)
add efb49f5e36d Stop prek hooks changing uv.lock and fail CI when it is
stale (#74803)
add 5941f0c19e0 Update providers metadata 2026-10-13 (#74648)
add ce0a1c474c9 add WasbDagBundle to load Dags from Azure Blob Storage
(#67016)
add 665b94999c3 Java SDK: Reject byte arrays instead of letting the task
hang (#74218)
add e1d881b5c4f Fix `SSHRemoteJobOperator` mangling environment values
with spaces or shell characters (#74810)
add 736c349cdca Fingerprint durable agent steps that hold sets or values
that are not JSON (#71575)
add 6997dc76fe5 Add async aget_conn and acreate_embeddings to OpenAIHook
(#74149)
add 91a8ab6950a Fix airflowctl pools export/import dropping pool team
ownership (#73132)
add d5ba49cbd6a Close German Translation Gaps 2026-10-15 (#74802)
add 4c4bab01e06 Allow loop gates to add human-readable decisions (#74806)
add 238bb6ee2bd Complete Hebrew UI translations 2026-10-16 (#74467)
add 4c98adf9e20 Skip the scheduler's Dag lookup for Dag runs with no
callback to send (#74835)
add 896f3711bdd Update Magpie floor to 0.9.0.dev202610140816 (#74815)
add 028a4da8672 Add Map Index search to dag breadcrumb (#74763)
add d11b39ed8d7 Distinguish invalid Dag access control from FAB backend
failures
add 772965c4dba Keep Dag parsing results aligned with refreshed bundle
sources
add 81e0b40aa67 Avoid parsing stalls while a bundle refresh waits for
imports
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (bffe26cb734)
\
N -- N -- N refs/heads/dag-processor-source-consistency
(81e0b40aa67)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.agents/skills/airflow-translations/locales/he.md | 32 +-
.apache-magpie.lock | 6 +-
.github/CODEOWNERS | 4 +-
.github/boring-cyborg.yml | 29 +-
.github/workflows/agent-framework-tests.yml | 4 +-
.github/workflows/automatic-backport.yml | 2 +-
.pre-commit-config.yaml | 20 +-
Dockerfile.ci | 6 +-
RELEASE_NOTES.rst | 24 +
.../administration-and-deployment/dag-bundles.rst | 3 +
.../docs/authoring-and-scheduling/loops.rst | 30 +-
airflow-core/docs/core-concepts/tasks.rst | 89 +-
airflow-core/docs/howto/deadline-alerts.rst | 25 +-
airflow-core/newsfragments/70714.significant.rst | 1 +
airflow-core/newsfragments/74709.bugfix.rst | 1 +
airflow-core/pyproject.toml | 2 +-
.../api_fastapi/core_api/datamodels/ui/grid.py | 14 +-
.../api_fastapi/core_api/openapi/_private_ui.yaml | 5 +
.../core_api/openapi/v2-rest-api-generated.yaml | 11 +
.../api_fastapi/core_api/routes/public/xcom.py | 18 +
.../core_api/services/public/task_instances.py | 11 +-
.../api_fastapi/core_api/services/ui/grid.py | 18 +-
.../src/airflow/api_fastapi/execution_api/app.py | 39 +-
.../execution_api/datamodels/taskinstance.py | 21 +
.../api_fastapi/execution_api/in_process.py | 15 +-
.../execution_api/routes/task_instances.py | 22 +-
.../api_fastapi/execution_api/routes/xcoms.py | 199 ++-
.../airflow/api_fastapi/execution_api/security.py | 1 +
.../api_fastapi/execution_api/versions/__init__.py | 2 +
.../execution_api/versions/v2026_10_30.py | 12 +
.../src/airflow/cli/commands/dag_command.py | 2 +
.../src/airflow/dag_processing/collection.py | 27 +
.../airflow/dag_processing/lang_sdk_processor.py | 11 +-
.../src/airflow/dag_processing/processor.py | 11 +-
.../airflow/example_dags/example_retry_policy.py | 26 +-
.../src/airflow/example_dags/example_task_loops.py | 6 +-
.../src/airflow/jobs/scheduler_job_runner.py | 9 +-
.../src/airflow/jobs/triggerer_job_runner.py | 58 +-
.../0142_3_4_0_unify_task_attempt_ownership.py | 263 ++-
airflow-core/src/airflow/models/dagrun.py | 44 +-
airflow-core/src/airflow/models/deadline.py | 139 +-
airflow-core/src/airflow/models/dynamic_region.py | 3 +-
airflow-core/src/airflow/models/taskinstance.py | 41 +-
airflow-core/src/airflow/models/trigger.py | 18 +-
.../src/airflow/serialization/definitions/dag.py | 2 +-
.../airflow/serialization/definitions/deadline.py | 90 +-
.../src/airflow/ui/openapi-gen/queries/common.ts | 5 +-
.../ui/openapi-gen/queries/ensureQueryData.ts | 6 +-
.../src/airflow/ui/openapi-gen/queries/prefetch.ts | 6 +-
.../src/airflow/ui/openapi-gen/queries/queries.ts | 6 +-
.../src/airflow/ui/openapi-gen/queries/suspense.ts | 6 +-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 5 +
.../ui/openapi-gen/requests/services.gen.ts | 2 +
.../airflow/ui/openapi-gen/requests/types.gen.ts | 8 +
.../airflow/ui/public/i18n/locales/de/common.json | 7 +
.../src/airflow/ui/public/i18n/locales/de/dag.json | 24 +-
.../airflow/ui/public/i18n/locales/de/dags.json | 4 +-
.../airflow/ui/public/i18n/locales/en/common.json | 2 +
.../src/airflow/ui/public/i18n/locales/en/dag.json | 1 +
.../airflow/ui/public/i18n/locales/en/dags.json | 1 +
.../airflow/ui/public/i18n/locales/he/admin.json | 35 +-
.../airflow/ui/public/i18n/locales/he/assets.json | 19 +-
.../airflow/ui/public/i18n/locales/he/browse.json | 35 +
.../airflow/ui/public/i18n/locales/he/common.json | 150 +-
.../ui/public/i18n/locales/he/components.json | 63 +-
.../src/airflow/ui/public/i18n/locales/he/dag.json | 122 +-
.../airflow/ui/public/i18n/locales/he/dags.json | 51 +-
.../ui/public/i18n/locales/he/dashboard.json | 26 +-
.../airflow/ui/src/components/Breadcrumb/Crumb.tsx | 22 +-
.../ui/src/components/Breadcrumb/CrumbSwitcher.tsx | 18 +-
.../src/components/DagActions/RunBackfillForm.tsx | 11 +-
.../LoopDecisionReason.tsx} | 28 +-
.../src/airflow/ui/src/components/SearchSelect.tsx | 113 +-
.../src/components/TriggerDag/TriggerDAGForm.tsx | 16 +-
.../airflow/ui/src/components/TriggerDag/types.ts | 5 +-
.../ui/src/constants/reprocessBehaviourParams.ts | 8 +-
.../ui/src/layouts/Details/DagBreadcrumb.test.tsx | 29 +-
.../ui/src/layouts/Details/DagBreadcrumb.tsx | 32 +-
.../src/layouts/Details/MapIndexSwitcherButton.tsx | 98 ++
.../ui/src/layouts/Details/SearchDagRuns.test.tsx | 38 +-
.../ui/src/layouts/Details/SearchDagRuns.tsx | 49 +-
.../ui/src/layouts/Details/SearchDags.test.tsx | 135 +-
.../airflow/ui/src/layouts/Details/SearchDags.tsx | 74 +-
.../src/layouts/Details/SearchMapIndexes.test.tsx | 192 +++
.../ui/src/layouts/Details/SearchMapIndexes.tsx | 168 ++
.../ui/src/layouts/Details/searchOptions.test.ts | 41 +-
.../ui/src/layouts/Details/searchOptions.ts | 59 +-
.../ui/src/pages/Dag/Backfills/Backfills.tsx | 11 +-
.../GroupTaskInstance/useLoopOutcomeStats.test.tsx | 64 +
.../GroupTaskInstance/useLoopOutcomeStats.tsx | 16 +-
.../src/airflow/ui/src/pages/ReactPlugin.test.tsx | 17 +
.../src/airflow/ui/src/pages/ReactPlugin.tsx | 4 +-
.../ui/src/pages/TaskInstance/Header.test.tsx | 34 +-
.../airflow/ui/src/pages/TaskInstance/Header.tsx | 12 +
.../pages/TaskStateStore/TaskStateStoreModal.tsx | 9 +-
.../src/airflow/ui/src/pages/XCom/XCom.test.tsx | 18 +
.../src/airflow/ui/src/pages/XCom/XCom.tsx | 1 +
airflow-core/src/airflow/ui/src/utils/option.ts | 10 +-
airflow-core/src/airflow/utils/cli.py | 2 +
.../core_api/routes/public/test_task_instances.py | 10 +-
.../core_api/routes/public/test_xcom.py | 48 +
.../api_fastapi/core_api/routes/ui/test_grid.py | 40 +-
.../unit/api_fastapi/execution_api/test_app.py | 4 +
.../execution_api/versions/head/test_router.py | 92 +-
.../versions/head/test_task_instances.py | 251 +--
.../execution_api/versions/head/test_xcoms.py | 189 ++-
.../tests/unit/cli/commands/test_dag_command.py | 69 +
.../tests/unit/dag_processing/test_collection.py | 44 +
airflow-core/tests/unit/jobs/test_scheduler_job.py | 36 +-
airflow-core/tests/unit/jobs/test_triggerer_job.py | 207 ++-
.../test_0142_unify_task_attempt_ownership.py | 530 +++++-
airflow-core/tests/unit/models/conftest.py | 8 +-
airflow-core/tests/unit/models/test_dagrun.py | 36 +-
airflow-core/tests/unit/models/test_deadline.py | 257 +--
.../tests/unit/models/test_deadline_alert.py | 84 +-
.../tests/unit/models/test_mappedoperator.py | 126 ++
.../tests/unit/models/test_taskinstance.py | 2 +-
airflow-core/tests/unit/models/test_trigger.py | 27 +-
airflow-core/tests/unit/utils/test_cli_util.py | 60 +
.../src/airflowctl/ctl/commands/pool_command.py | 2 +
.../airflow_ctl/ctl/commands/test_pool_command.py | 45 +
contributing-docs/07_local_virtualenv.rst | 8 +-
.../src/airflow_breeze/utils/selective_checks.py | 1 -
.../src/airflow_breeze/utils/verification_plan.py | 5 +
dev/breeze/tests/test_selective_checks.py | 50 +-
dev/breeze/tests/test_shim_version_check.py | 4 +-
dev/breeze/tests/test_verification_plan.py | 12 +
generated/provider_metadata.json | 422 +++++
go-sdk/pkg/execution/genmodels/models.gen.go | 22 +-
go-sdk/schema/supervisor-schema.json | 49 +
.../main/kotlin/org/apache/airflow/sdk/Client.kt | 5 +-
.../org/apache/airflow/sdk/execution/MsgPack.kt | 13 +-
.../org/apache/airflow/sdk/execution/CommTest.kt | 34 +
.../airflow/providers/amazon/aws/waiters/dms.json | 4 +-
.../tests/unit/amazon/aws/waiters/test_dms.py | 36 +-
providers/common/ai/README.rst | 2 +-
providers/common/ai/docs/approval_gates.rst | 211 ++-
providers/common/ai/docs/capabilities.rst | 5 +-
providers/common/ai/docs/code_mode.rst | 5 +-
providers/common/ai/docs/durable_execution.rst | 82 +-
providers/common/ai/docs/features.rst | 10 +-
providers/common/ai/docs/frameworks/index.rst | 39 +-
.../common/ai/docs/frameworks/openai_agents.rst | 162 ++
.../ai/docs/img/approval_required_actions.png | Bin 0 -> 78595 bytes
.../common/ai/docs/img/approval_review_form.png | Bin 0 -> 95532 bytes
providers/common/ai/docs/index.rst | 2 +-
providers/common/ai/docs/observability.rst | 42 +-
providers/common/ai/docs/operators/agent.rst | 7 +-
providers/common/ai/docs/operators/llm.rst | 7 +-
providers/common/ai/docs/recovery.rst | 3 +-
providers/common/ai/docs/retry_policies.rst | 4 +-
providers/common/ai/docs/sandbox/index.rst | 4 +-
providers/common/ai/docs/stability.rst | 10 +-
providers/common/ai/docs/toolsets/index.rst | 10 +-
providers/common/ai/docs/toolsets/logging.rst | 4 +-
.../ai/docs/toolsets/progressive_disclosure.rst | 146 ++
providers/common/ai/docs/toolsets/skills.rst | 10 +-
providers/common/ai/docs/troubleshooting.rst | 6 +-
providers/common/ai/pyproject.toml | 11 +-
.../providers/common/ai/durable/fingerprint.py | 509 +++++-
.../common/ai/example_dags/example_agent_memory.py | 2 +-
.../common/ai/example_dags/example_llm_approval.py | 54 +
.../ai/example_dags/example_openai_agents_agent.py | 90 ++
.../example_progressive_tool_disclosure.py | 107 ++
.../airflow/providers/common/ai/mixins/approval.py | 12 +-
.../airflow/providers/common/ai/observability.py | 5 +
.../airflow/providers/common/ai/operators/agent.py | 12 +-
.../airflow/providers/common/ai/operators/llm.py | 18 +-
.../airflow/providers/common/ai/policies/retry.py | 18 +-
.../airflow/providers/common/ai/tools/__init__.py | 4 +-
.../providers/common/ai/tools/openai_agents.py | 391 +++++
.../airflow/providers/common/ai/tools/tracing.py | 11 +-
.../providers/common/ai/utils/tool_metrics.py | 2 +-
.../unit/common/ai/durable/test_capability.py | 58 +
.../tests/unit/common/ai/durable/test_code_mode.py | 229 +++
.../unit/common/ai/durable/test_fingerprint.py | 1687 +++++++++++++++++++-
.../tests/unit/common/ai/operators/test_agent.py | 48 +-
.../ai/tests/unit/common/ai/policies/test_retry.py | 37 +-
.../unit/common/ai/tools/test_openai_agents.py | 611 +++++++
.../providers/common/compat/_retry_policy.py | 5 +-
.../tests/unit/common/compat/test__retry_policy.py | 16 +
providers/microsoft/azure/docs/bundles/index.rst | 80 +
providers/microsoft/azure/docs/index.rst | 1 +
providers/microsoft/azure/provider.yaml | 5 +
.../providers/microsoft/azure/bundles}/__init__.py | 0
.../providers/microsoft/azure/bundles/wasb.py | 154 ++
.../providers/microsoft/azure/get_provider_info.py | 6 +
.../providers/microsoft/azure/hooks/wasb.py | 108 ++
.../unit/microsoft/azure/bundles}/__init__.py | 0
.../unit/microsoft/azure/bundles/test_wasb.py | 279 ++++
.../tests/unit/microsoft/azure/hooks/test_wasb.py | 160 ++
providers/openai/pyproject.toml | 2 +-
.../src/airflow/providers/openai/hooks/openai.py | 79 +-
.../openai/tests/unit/openai/hooks/test_openai.py | 202 ++-
providers/ssh/docs/operators/ssh_remote_job.rst | 4 +
.../providers/ssh/operators/ssh_remote_job.py | 4 +-
.../src/airflow/providers/ssh/utils/remote_job.py | 9 +-
.../ssh/tests/unit/ssh/utils/test_remote_job.py | 42 +-
reproducible_build.yaml | 4 +-
scripts/ci/prek/upgrade_important_versions.py | 2 +-
scripts/in_container/bin/generate_mprocs_config.py | 3 +-
scripts/in_container/run_agent_framework_tests.sh | 36 +-
.../in_container/run_provider_yaml_files_check.py | 10 +-
.../in_container/test_generate_mprocs_config.py | 19 +-
scripts/tools/setup_breeze | 5 +-
.../observability/metrics/metrics_template.yaml | 3 +-
task-sdk/docs/api.rst | 2 +
task-sdk/docs/index.rst | 1 +
task-sdk/src/airflow/sdk/__init__.py | 3 +
task-sdk/src/airflow/sdk/__init__.pyi | 2 +
task-sdk/src/airflow/sdk/api/client.py | 16 +-
.../src/airflow/sdk/api/datamodels/_generated.py | 14 +
.../src/airflow/sdk/definitions/_internal/loop.py | 10 +-
task-sdk/src/airflow/sdk/definitions/deadline.py | 37 +-
.../sdk/definitions/decorators/task_group.py | 6 +-
.../src/airflow/sdk/definitions/loop.py | 20 +-
.../src/airflow/sdk/definitions/retry_policy.py | 94 +-
task-sdk/src/airflow/sdk/execution_time/comms.py | 7 +
task-sdk/src/airflow/sdk/execution_time/loop.py | 70 +-
.../airflow/sdk/execution_time/schema/schema.json | 49 +
.../execution_time/schema/versions/v2026_10_30.py | 12 +-
.../src/airflow/sdk/execution_time/supervisor.py | 12 +-
.../src/airflow/sdk/execution_time/task_runner.py | 74 +-
task-sdk/tests/task_sdk/api/test_client.py | 27 +
.../task_sdk/definitions/test_retry_policy.py | 121 +-
.../tests/task_sdk/execution_time/test_loop.py | 214 ++-
.../task_sdk/execution_time/test_supervisor.py | 24 +-
.../task_sdk/execution_time/test_task_runner.py | 191 +++
ts-sdk/schema/supervisor-schema.json | 49 +
ts-sdk/src/generated/supervisor.ts | 14 +
uv.lock | 16 +-
231 files changed, 11429 insertions(+), 1747 deletions(-)
create mode 100644 airflow-core/newsfragments/70714.significant.rst
create mode 100644 airflow-core/newsfragments/74709.bugfix.rst
copy airflow-core/src/airflow/ui/src/{layouts/Details/Grid/DurationTick.tsx =>
components/LoopDecisionReason.tsx} (67%)
create mode 100644
airflow-core/src/airflow/ui/src/layouts/Details/MapIndexSwitcherButton.tsx
create mode 100644
airflow-core/src/airflow/ui/src/layouts/Details/SearchMapIndexes.test.tsx
create mode 100644
airflow-core/src/airflow/ui/src/layouts/Details/SearchMapIndexes.tsx
create mode 100644
airflow-core/src/airflow/ui/src/pages/GroupTaskInstance/useLoopOutcomeStats.test.tsx
create mode 100644 providers/common/ai/docs/frameworks/openai_agents.rst
create mode 100644 providers/common/ai/docs/img/approval_required_actions.png
create mode 100644 providers/common/ai/docs/img/approval_review_form.png
create mode 100644 providers/common/ai/docs/toolsets/progressive_disclosure.rst
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_llm_approval.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_openai_agents_agent.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_progressive_tool_disclosure.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/tools/openai_agents.py
create mode 100644
providers/common/ai/tests/unit/common/ai/durable/test_code_mode.py
create mode 100644
providers/common/ai/tests/unit/common/ai/tools/test_openai_agents.py
create mode 100644 providers/microsoft/azure/docs/bundles/index.rst
copy {airflow-core/src/airflow/_shared =>
providers/microsoft/azure/src/airflow/providers/microsoft/azure/bundles}/__init__.py
(100%)
create mode 100644
providers/microsoft/azure/src/airflow/providers/microsoft/azure/bundles/wasb.py
copy {airflow-core/src/airflow/_shared =>
providers/microsoft/azure/tests/unit/microsoft/azure/bundles}/__init__.py (100%)
create mode 100644
providers/microsoft/azure/tests/unit/microsoft/azure/bundles/test_wasb.py
copy dev/breeze/src/airflow_breeze/utils/helm_chart_utils.py =>
scripts/tests/in_container/test_generate_mprocs_config.py (62%)
copy airflow-core/tests/unit/task/conftest.py =>
task-sdk/src/airflow/sdk/definitions/loop.py (66%)
