This is an automated email from the ASF dual-hosted git repository.
jscheffl pushed a change to branch ci-upgrade-main
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 8f4a2461bb0 [main] CI: Upgrade important CI environment
add 04b12c2540e Fix ktlint dependency to discriminator (#68058)
add 47faf3c0723 Fix coroutine serialization error in
PowerBIDatasetRefreshOperator (#63829)
add 477cbedcedc Reduce redundant Dag team lookups in authorization checks
(#68020)
add 0ac475f1d8a Add Amazon Bedrock AgentCore Runtime operators (#67984)
add 2dcfd7ccd2a Fix Java-SDK e2e test registration (#67993)
add 18caee14972 Fix trigger datetime deserialization (#67795)
add f1a5d1edab4 Fix Typo in HTTP Connection Example (#68076)
add d452d2769df Only force the full test matrix on API changes when the
contract changes (#68060)
add 36356cc0d48 Don't force the full test matrix for large test/docs-only
PRs (#68059)
add 834385195f5 Fix CI/CD running full matrix on push to release branches
(v3-X-test) (#68057)
add e9a41115aea Implements Support for Format="Duration" in Params (#65469)
add c2dbd7a75ad Fix IDC domain S3 path resolution (#67987)
add a5d91ed2838 Bump the edge-ui-package-updates group across 1 directory
with 7 updates (#68087)
add 7e55559406e fix: guard the to.finish stats emission (#67955)
add db6ce848baf Improve AIP progress tracker example for accuracy (#68037)
add 5dde3cdf1d5 Improve SnowflakeSqlApiOperator error message on query
status check failure (#66642)
add 9326f169f48 CI: drive milestone auto-tag skip from live labels + issue
events (#67518)
add d4a5294dcef Add token_provider for short-lived MCP auth in common.ai
(#68104)
add a218626923b Remove large-PR heuristic from selective checks (#68109)
add d88504564c5 Support multi-schema introspection in common.ai SQLToolset
(#68103)
add a77dcb6cc96 Allow DESCRIBE/SHOW in common.ai SQLToolset read-only
queries (#68102)
add 007ce9d11eb Add Snowflake Workload Identity Federation (WIF) support
(#68107)
add e371845a222 Verify TCP connection ownership before accepting Java
coordinator supervisor channel (#67781)
add 294467ab1f9 Exclude auto-generated REST API reference from docs
spell-check (#68114)
add b64a0e636d9 Add `awaiting_input` task state for Human-in-the-loop, off
the triggerer (#68028)
add 97e90643dbf Document selective-checks algorithm and heuristics (#68116)
add 31fcbf65cc2 UI: Add checkboxes to clear task instances (#68029)
add 0c5da3d3d37 Revert "Fix CI/CD running full matrix on push to release
branches (v3-X-test) (#68057)" (#68120)
add 0effe0af7ce Add Zomato to INTHEWILD.md (#68123)
add d2161ae04cb Hide Dashboard metric percentages when a state count is
capped (#67664)
add a4ea3ffc405 Fix LatestBoto CI test stuck at boto3 1.38.2 (below
provider minimum) (#68122)
add da414ede139 [main] CI: Upgrade important CI environment
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (8f4a2461bb0)
\
N -- N -- N refs/heads/ci-upgrade-main (da414ede139)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/additional-prod-image-tests.yml | 16 +
.github/workflows/ci-amd.yml | 2 +
.github/workflows/ci-arm.yml | 2 +
AGENTS.md | 1 +
Dockerfile.ci | 6 +-
INTHEWILD.md | 1 +
.../docs/authoring-and-scheduling/deferring.rst | 6 +
airflow-core/docs/conf.py | 6 +-
airflow-core/docs/core-concepts/overview.rst | 3 +-
airflow-core/docs/core-concepts/params.rst | 3 +
airflow-core/docs/core-concepts/tasks.rst | 1 +
.../docs/img/diagram_task_lifecycle.md5sum | 2 +-
airflow-core/docs/img/diagram_task_lifecycle.png | Bin 601178 -> 671852
bytes
airflow-core/docs/img/diagram_task_lifecycle.py | 23 +-
airflow-core/docs/security/audit_logs.rst | 1 +
airflow-core/docs/tutorial/hitl.rst | 11 +
airflow-core/newsfragments/68028.feature.rst | 1 +
airflow-core/pyproject.toml | 1 +
airflow-core/src/airflow/api/common/mark_tasks.py | 1 +
.../src/airflow/api_fastapi/common/parameters.py | 3 +-
.../core_api/datamodels/ui/dashboard.py | 1 +
.../api_fastapi/core_api/openapi/_private_ui.yaml | 5 +
.../core_api/openapi/v2-rest-api-generated.yaml | 1 +
.../api_fastapi/core_api/routes/public/hitl.py | 52 +
.../airflow/api_fastapi/core_api/routes/ui/dags.py | 2 +-
.../execution_api/datamodels/taskinstance.py | 30 +
.../execution_api/routes/task_instances.py | 47 +-
.../api_fastapi/execution_api/versions/__init__.py | 8 +-
.../execution_api/versions/v2026_06_30.py | 18 +-
.../src/airflow/config_templates/config.yml | 11 +
.../example_dags/example_params_ui_tutorial.py | 9 +
.../src/airflow/jobs/scheduler_job_runner.py | 106 +-
airflow-core/src/airflow/models/dag.py | 13 +
airflow-core/src/airflow/models/dagrun.py | 5 +-
airflow-core/src/airflow/models/hitl.py | 18 +
airflow-core/src/airflow/models/taskinstance.py | 12 +-
.../src/airflow/serialization/definitions/param.py | 8 +-
.../src/airflow/ti_deps/dependencies_states.py | 7 +
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 8 +-
.../airflow/ui/openapi-gen/requests/types.gen.ts | 3 +-
.../airflow/ui/public/i18n/locales/en/common.json | 1 +
.../ui/public/i18n/locales/en/components.json | 2 +
.../components/ActionAccordion/ActionAccordion.tsx | 11 +-
.../ui/src/components/ActionAccordion/columns.tsx | 61 +-
.../ClearTaskInstanceConfirmationDialog.tsx | 12 +-
.../Clear/TaskInstance/ClearTaskInstanceDialog.tsx | 162 ++-
.../components/FlexibleForm/FieldDuration.test.tsx | 105 ++
.../{FieldStringArray.tsx => FieldDuration.tsx} | 58 +-
.../src/components/FlexibleForm/FieldSelector.tsx | 6 +
.../src/components/FlexibleForm/FlexibleForm.tsx | 6 +-
.../ui/src/components/NeedsReviewButton.tsx | 2 +-
.../src/airflow/ui/src/components/StateIcon.tsx | 11 +-
.../src/airflow/ui/src/constants/stateOptions.ts | 1 +
.../airflow/ui/src/hooks/useRequiredActionTabs.ts | 4 +-
.../Dashboard/HistoricalMetrics/DagRunMetrics.tsx | 5 +
.../Dashboard/HistoricalMetrics/MetricSection.tsx | 5 +-
.../HistoricalMetrics/TaskInstanceMetrics.tsx | 6 +
.../HITLTaskInstances/HITLResponseForm.test.tsx | 34 +
.../pages/HITLTaskInstances/HITLResponseForm.tsx | 4 +-
.../HITLTaskInstances/HITLTaskInstances.test.tsx | 49 +
.../pages/HITLTaskInstances/HITLTaskInstances.tsx | 12 +-
airflow-core/src/airflow/ui/src/theme.ts | 1 +
airflow-core/src/airflow/ui/src/utils/hitl.test.ts | 52 +-
airflow-core/src/airflow/ui/src/utils/hitl.ts | 12 +-
airflow-core/src/airflow/ui/src/utils/query.ts | 1 +
.../src/airflow/ui/src/utils/stateUtils.ts | 1 +
.../src/airflow/ui/tests/e2e/utils/test-helpers.ts | 10 +-
airflow-core/src/airflow/utils/state.py | 5 +
.../core_api/routes/public/test_hitl.py | 55 +
.../core_api/routes/public/test_task_instances.py | 2 +-
.../core_api/routes/ui/test_dashboard.py | 3 +
.../tests/unit/dag_processing/test_processor.py | 1 +
airflow-core/tests/unit/jobs/test_scheduler_job.py | 92 ++
airflow-core/tests/unit/jobs/test_triggerer_job.py | 1 +
airflow-core/tests/unit/models/test_dag.py | 28 +
airflow-core/tests/unit/models/test_trigger.py | 21 +
.../unit/serialization/definitions/test_param.py | 60 ++
.../tests/unit/serialization/test_encoders.py | 17 +-
.../src/airflowctl/api/datamodels/generated.py | 1 +
dev/breeze/doc/ci/04_selective_checks.md | 306 +++++-
.../src/airflow_breeze/commands/ci_commands.py | 217 ++--
.../src/airflow_breeze/utils/selective_checks.py | 139 +--
dev/breeze/tests/test_selective_checks.py | 373 +++----
dev/breeze/tests/test_set_milestone.py | 326 +++++-
.../task_lifecycle/awaiting_input_state.png | Bin 0 -> 2467 bytes
devel-common/src/tests_common/pytest_plugin.py | 25 +
docs/spelling_wordlist.txt | 2 +
generated/provider_dependencies.json | 2 +-
generated/provider_dependencies.json.sha256sum | 2 +-
java-sdk/sdk/build.gradle.kts | 7 +-
providers/amazon/docs/operators/bedrock.rst | 52 +
.../airflow/providers/amazon/aws/hooks/bedrock.py | 40 +
.../aws/hooks/sagemaker_unified_studio_notebook.py | 39 +-
.../providers/amazon/aws/operators/bedrock.py | 247 +++++
.../providers/amazon/aws/triggers/bedrock.py | 53 +-
...nctions.json => bedrock-agentcore-control.json} | 28 +-
.../system/amazon/aws/example_bedrock_agentcore.py | 111 ++
.../tests/unit/amazon/aws/hooks/test_bedrock.py | 4 +
.../test_sagemaker_unified_studio_notebook.py | 36 +-
.../unit/amazon/aws/operators/test_bedrock.py | 249 ++++-
.../tests/unit/amazon/aws/triggers/test_bedrock.py | 47 +-
.../aws/waiters/test_bedrock_agentcore_control.py | 74 ++
providers/common/ai/docs/connections/mcp.rst | 40 +-
providers/common/ai/docs/toolsets.rst | 56 +-
.../example_dags/example_aip_progress_tracker.py | 1057 +++++++++++++++++---
.../ai/example_dags/skills/aip-tracker/SKILL.md | 143 +++
.../src/airflow/providers/common/ai/hooks/mcp.py | 62 +-
.../providers/common/ai/operators/llm_sql.py | 11 +-
.../airflow/providers/common/ai/toolsets/mcp.py | 19 +-
.../airflow/providers/common/ai/toolsets/sql.py | 112 ++-
.../providers/common/ai/utils/sql_validation.py | 75 +-
.../ai/tests/unit/common/ai/hooks/test_mcp.py | 102 +-
.../ai/tests/unit/common/ai/toolsets/test_mcp.py | 20 +-
.../ai/tests/unit/common/ai/toolsets/test_sql.py | 194 +++-
.../unit/common/ai/utils/test_sql_validation.py | 101 +-
.../providers/edge3/plugins/www/package.json | 14 +-
.../providers/edge3/plugins/www/pnpm-lock.yaml | 539 +++++-----
.../edge3/worker_api/v2-edge-generated.yaml | 1 +
providers/http/docs/connections/http.rst | 2 +-
.../providers/microsoft/azure/operators/powerbi.py | 63 +-
.../unit/microsoft/azure/operators/test_powerbi.py | 177 +++-
providers/snowflake/README.rst | 2 +-
providers/snowflake/docs/connections/snowflake.rst | 42 +-
providers/snowflake/docs/index.rst | 2 +-
providers/snowflake/pyproject.toml | 3 +-
.../airflow/providers/snowflake/hooks/snowflake.py | 23 +-
.../providers/snowflake/operators/snowflake.py | 2 +-
.../tests/unit/snowflake/hooks/test_snowflake.py | 95 ++
.../unit/snowflake/operators/test_snowflake.py | 17 +
.../airflow/providers/standard/operators/hitl.py | 37 +-
.../tests/unit/standard/operators/test_hitl.py | 83 +-
scripts/docker/entrypoint_ci.sh | 6 +-
.../src/airflow_shared/serialization/__init__.py | 1 +
task-sdk/pyproject.toml | 1 +
task-sdk/src/airflow/sdk/api/client.py | 6 +
.../src/airflow/sdk/api/datamodels/_generated.py | 17 +
.../src/airflow/sdk/coordinators/_subprocess.py | 35 +
task-sdk/src/airflow/sdk/definitions/param.py | 10 +-
task-sdk/src/airflow/sdk/exceptions.py | 42 +
task-sdk/src/airflow/sdk/execution_time/comms.py | 10 +-
.../airflow/sdk/execution_time/schema/schema.json | 77 +-
.../src/airflow/sdk/execution_time/supervisor.py | 18 +-
.../src/airflow/sdk/execution_time/task_runner.py | 38 +-
.../src/airflow/sdk/serde/serializers/datetime.py | 6 +
.../tests/task_sdk/coordinators/test_subprocess.py | 101 ++
task-sdk/tests/task_sdk/definitions/test_param.py | 33 +
.../task_sdk/execution_time/test_supervisor.py | 9 +
.../task_sdk/execution_time/test_task_runner.py | 37 +
task-sdk/tests/task_sdk/serde/test_serializers.py | 18 +
uv.lock | 31 +-
150 files changed, 6169 insertions(+), 1174 deletions(-)
create mode 100644 airflow-core/newsfragments/68028.feature.rst
create mode 100644
airflow-core/src/airflow/ui/src/components/FlexibleForm/FieldDuration.test.tsx
copy
airflow-core/src/airflow/ui/src/components/FlexibleForm/{FieldStringArray.tsx
=> FieldDuration.tsx} (56%)
create mode 100644
airflow-core/tests/unit/serialization/definitions/test_param.py
create mode 100644
devel-common/src/docs/diagrams/task_lifecycle/awaiting_input_state.png
copy
providers/amazon/src/airflow/providers/amazon/aws/waiters/{stepfunctions.json
=> bedrock-agentcore-control.json} (50%)
create mode 100644
providers/amazon/tests/system/amazon/aws/example_bedrock_agentcore.py
create mode 100644
providers/amazon/tests/unit/amazon/aws/waiters/test_bedrock_agentcore_control.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/skills/aip-tracker/SKILL.md
