This is an automated email from the ASF dual-hosted git repository.
rahulvats pushed a change to branch v3-2-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 2ea32d9e7cd Update default branches for 3-2
add 05a1c9c4e73 Temporarily pin virtualenv to resolve build issues (#62503)
add 3ab2eb9884c fix(amazon): Filter kwargs in AthenaSQLHook to prevent
TypeError (#62227)
add 7dfd39b9385 Migrate alibaba connection UI metadata to YAML (#62379)
add 641ad7382f1 Migrate apache/hive connection UI metadata to YAML (#62380)
add 7e47ead9a5f Migrate apache/spark connection UI metadata to YAML
(#62381)
add 6e8fbd8e5ac Migrate trino/cohere connection UI metadata to YAML
(#62390)
add 4dc0883d055 Return files destination uris in
`GoogleDriverToGCSOperator` and `SheetsToGCSOperator` (#61347)
add ba2384ac8c1 chore(deps): bump rollup (#62507)
add 7205e2622b4 Regulatory update to prek hook that checks core imports in
sdk (#62513)
add 93144ab1578 Add end-to-end feature checklist to Execution API
AGENTS.md (#62481)
add 76679f66610 Cap ``gunicorn`` below 25.1.0 to avoid API server startup
deadlocks (#62524)
add 15fce018c86 feat(airflowctl): support on headless environments (#62217)
add 67a86d50c16 Make the gunicorn API server respect GUNICORN_CMD_ARGS
again (#62522)
add d4f7a227d4b Exclude translation skills from codespell (#62508)
add a1ddf31098a Prepare documentation for next release of providers
(2026-02-24) (#62495)
add 999d71e8270 Update Variables docs - bug fix and multi-team (#62439)
add ab1e40c029a Check teams defined in auth managers exist in DB when
spinning up API server (#62527)
add 6a21460f0cf Clean up stale Python 3.9 workaround in airflow-ctl CLI
config parser (#62206)
add f64097f18c6 CI: Upgrade important CI environment (#62531)
add ab76f02dd9e Fix building docs for providers (#62538)
add 00c69f5ae97 Add ingress deprecation warnings for apiServer, statsd,
and pgbouncer (#62490)
add f22dbc02403 Add workers.celery.containerLifecycleHooks &
workers.kubernetes.containerLifecycleHooks (#61369)
add 6d146c06b79 Dependabot: Upgrade vulnerable rolloup in core UI (#62536)
add f442ed280bb Changed dag_bundle.signed_url_template from varchar(200)
to text (#61041)
add 3b27a624404 CI: Upgrade important CI environment (#62540)
add eeaffb5e9af Enable multi-team in Celery executor (#62534)
add 68691417109 Fix deadline alert hashing bug (#61702)
add ceaf359a657 Add French (fr) translation agent skill (#62161)
add 04b921bc3a1 Add translation agent skill guidelines for Thai (th)
locale (#62170)
add febf1fe70ee fix DataprocSubmitTrigger deferred tasks stuck forever
(#62082)
add b65690196d5 Protect supervisor memory from being read by sibling task
processes (#62523)
add 77e057fcb18 Migrate JDBC connection UI metadata to YAML (#62427)
add 0fcb459402c Migrate Jenkins connection UI metadata to YAML (#62432)
add 37c480df752 Migrate-airbyte-connection-UI-metadata-to-YAML (#62426)
add f03beb90287 Migrate mongo connection UI metadata to YAML (#62444)
add 0157e0ebe6c Migrate postgres connection UI metadata to YAML (#62445)
add 2e5023d853f Migrate salesforce connection UI metadata to YAML (#62446)
add 917abea0d2b Suspend Apache Beam Provider due to grpcio limitation
(#61926)
add 8a3a5222e39 Add support to create connections using uri in SDK (#62211)
add 5639a878a47 Fix deadline typo (#62486)
add 352feb2b615 Add base react plugin destination (#62530)
add b7418576cc7 Raise on unexpected terminal dbt Cloud job run states
(#61300)
add 0734b4f4c44 Add known issue notice for version 19.5.0 (#61927)
add 85085a46deb Migrate samba connection UI metadata to YAML (#62514)
add e4de653c33d Add sync and async helpers to resolve the dbt Cloud
account ID from the (#61757)
add 5eed7c76b69 Add PR creation instructions for AI agents to AGENTS.md
(#62575)
add cb265158bf7 chore(deps-dev): bump eslint-plugin-react-refresh (#62576)
add e7abe603d47 Remove debug traces (#62572)
add 840bcf30247 Add `PydanticAIHook` to `common.ai` provider (#62546)
add 94e189618ab Fix all build-system/requires including transitive
dependencies (#62570)
add 720dcb3f1f5 Clean generated _api folders from docs directories in
prepare-provider-distributions (#62573)
add a06453823a1 Strengthen Copilot review instructions to use imperative
"Flag any" phrasing (#62584)
add 92954d87415 Add `breeze issues unassign` command to clean up
non-collaborator assignees (#62585)
add 93f34b37380 Fix release documentation for Airflow-CTL PMC check
(#62483)
add e034749cdb3 Fix max_lines_per_page config setting for
ElasticsearchRemoteLogIO (#62562)
add b0989b19519 Retcon migration chain: move signed_url_template change to
3.1.8 (#62569)
add 442a9a83aa1 Cache DbApiHook.inspector to avoid creating N engines
(#62594)
add a46ab402658 Fix edge3 executor startup crash on Airflow < 3.2 (#62593)
add fe284c77837 AIP-99: Add AnalyticsOperator (#62232)
add 2440d198873 Add `LLMOperator` and `@task.llm` to common.ai provider
(#62598)
add 66bf73f2c30 Upgrade Hatch to 1.16.5 and revert virtualenv pin (#62602)
add 0699930e26c CI: Upgrade important CI environment (#62610)
add 25c0eb5bbac Add CODEOWNERS for agentic instruction files (#62618)
add 0154d8e5007 Clarify assignment policy for issues (#62417)
add 85a5a61844b CI: Replace curl-based uv installation with pip install
from PyPI (#62619)
add e5301eab04b Add policy comment when unassigning non-collaborators from
issues (#62621)
add da4ce85ace8 Add `LLMSQLQueryOperator` and `@task.llm_sql` to common.ai
provider (#62599)
add d43a9844c9d Fix typo in skipLatest in release-dockerhub-images
workflow (#62637)
add 8839453904f airflow-ctl: Add coverage tests for console formatting
output (#62627)
add 4e8bfe8dd89 Update multi-team docs for per team executor config
(#62545)
add c48c219b1d2 Don't validate team existence during dag validation
(#62596)
add 4ac550d7318 Adding description of restrictions on creation of a new
team name (#62448)
add 12906fed21f Add release notes about grpcio downgraded for Python 3.12,
2.11.1 image. (#62635)
add 0ddf5174d5f Add self-review checklist for AI agents in AGENTS.md
(#62617)
add 9fa13c82ff7 Executor Synchronous callback workload (#61153)
add 50b0775c136 Update provider's compatibility matrix with 2.11.1 (#62295)
add 2525023a567 Fix "Docker is not running" error guidance for GitHub
Codespaces (#62580)
add 0ffb28ed0d1 Add ObjectStorage support to LLMSQLQueryOperator via
DataFusion (#62640)
add 07945cbcc7f Add @task.analytics Decorator (#62648)
add bfc6c8e03a1 Add catalog introspection to IcebergHook using pyiceberg
(#62634)
add da54f361349 Add more CODEOWNERS for agentic instruction files (#62661)
add abf98b5f3a8 Docs: clarify restarting Airflow components after
installing provider in Breeze (#62666)
add 1ae6a2a963c Fix tpl rendering for TLS hosts in ingress templates
#62358 (#62548)
add 94ece75ecbf Add workers.celery.podDisruptionBudget (#61414)
add 45efea70f1b Close German Translation Gaps 2026-02-25 (#62489)
add 260406b0c78 Dependabot: Upgrade vulnerable rolloup (#62535)
add 72af427f428 Close Catalan translation gap (main) (#62476)
add 045813df34d Switch from surrogateescape to replace to handle utf-8
error (#62632)
add 51f097b756f Fix ambiguity of AGENT instructions (#62677)
add 06e3b42d780 Add `--max-num` flag to `breeze issues unassign` command
(#62673)
add dda8d278671 Fix `airflowctl connections import` failure when JSON
omits `extra` field (#62662)
add e68c525ea7f Add ClusterType field for Zero-Scale cluster support
(#62207)
add f5d7a3a6bb7 Explicitly set extra for connections in generic transfer
tests (#62581)
add a7b8c7f0123 Make weight_rule independent of airflow-core
priority_strategy (#62210)
new 34da816343a Update default branches for 3-2
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (2ea32d9e7cd)
\
N -- N -- N refs/heads/v3-2-test (34da816343a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.devcontainer/devcontainer.json | 3 +
.devcontainer/mysql/devcontainer.json | 3 +
.devcontainer/postgres/devcontainer.json | 3 +
.github/CODEOWNERS | 7 +
.github/actions/breeze/action.yml | 4 +-
.github/actions/install-prek/action.yml | 6 +-
.github/instructions/code-review.instructions.md | 52 +-
.github/skills/airflow-translations/locales/fr.md | 190 +
.github/skills/airflow-translations/locales/th.md | 296 ++
.github/workflows/airflow-distributions-tests.yml | 3 +-
.github/workflows/basic-tests.yml | 18 +-
.github/workflows/ci-amd-arm.yml | 3 +-
.github/workflows/publish-docs-to-s3.yml | 1 +
.github/workflows/release_dockerhub_image.yml | 4 +-
.pre-commit-config.yaml | 5 +-
AGENTS.md | 73 +-
Dockerfile | 2 +-
Dockerfile.ci | 4 +-
.../docs/administration-and-deployment/plugins.rst | 5 +-
airflow-core/docs/best-practices.rst | 2 +-
airflow-core/docs/core-concepts/multi-team.rst | 80 +
airflow-core/docs/core-concepts/variables.rst | 9 +-
airflow-core/docs/img/airflow_erd.sha256 | 2 +-
airflow-core/docs/img/airflow_erd.svg | 4982 +++++++++++---------
airflow-core/docs/migrations-ref.rst | 4 +-
airflow-core/pyproject.toml | 19 +-
.../api_fastapi/auth/managers/base_auth_manager.py | 22 +-
.../auth/managers/simple/simple_auth_manager.py | 5 +
.../auth/managers/simple/ui/package-lock.json | 253 +-
.../auth/managers/simple/ui/package.json | 5 +-
.../auth/managers/simple/ui/pnpm-lock.yaml | 221 +-
.../api_fastapi/core_api/datamodels/plugins.py | 2 +-
.../api_fastapi/core_api/datamodels/ui/deadline.py | 2 +-
.../api_fastapi/core_api/openapi/_private_ui.yaml | 34 +-
.../core_api/openapi/v2-rest-api-generated.yaml | 2 +
.../api_fastapi/core_api/routes/ui/deadlines.py | 6 +-
.../airflow/api_fastapi/execution_api/AGENTS.md | 23 +
.../src/airflow/api_fastapi/gunicorn_app.py | 12 +-
airflow-core/src/airflow/cli/cli_config.py | 3 +
.../src/airflow/cli/commands/team_command.py | 2 +-
airflow-core/src/airflow/dag_processing/dagbag.py | 6 +-
airflow-core/src/airflow/dag_processing/manager.py | 15 +-
.../src/airflow/executors/base_executor.py | 143 +-
.../src/airflow/executors/executor_loader.py | 4 +-
.../src/airflow/executors/local_executor.py | 90 +-
airflow-core/src/airflow/executors/workloads.py | 210 -
.../workloads/__init__.py} | 17 +-
.../src/airflow/executors/workloads/base.py | 85 +
.../src/airflow/executors/workloads/callback.py | 158 +
.../src/airflow/executors/workloads/task.py | 104 +
.../calendar.py => executors/workloads/trigger.py} | 34 +-
.../src/airflow/executors/workloads/types.py | 40 +
airflow-core/src/airflow/jobs/job.py | 115 +-
.../src/airflow/jobs/scheduler_job_runner.py | 580 ++-
.../src/airflow/jobs/triggerer_job_runner.py | 28 +-
..._8_change_signed_url_template_from_varchar_.py} | 42 +-
..._2_0_replace_asset_trigger_table_with_asset.py} | 4 +-
..._change_serialized_dag_data_column_to_jsonb.py} | 0
..._2_0_add_length_dag_bundle_team_bundle_name.py} | 0
..._3_2_0_add_human_in_the_loop_detail_history.py} | 0
...py => 0092_3_2_0_add_fail_fast_to_dag_table.py} | 0
...py => 0093_3_2_0_restructure_callback_table.py} | 0
..._replace_deadline_inline_callback_with_fkey.py} | 0
...=> 0095_3_2_0_update_orm_asset_partitioning.py} | 0
...ove_team_id.py => 0096_3_2_0_remove_team_id.py} | 0
...enforce_log_event_and_dag_is_stale_not_null.py} | 0
...y => 0098_3_2_0_add_queue_column_to_trigger.py} | 0
..._2_0_add_exceeds_max_runs_flag_to_dag_model.py} | 0
..._3_2_0_add_timetable_type_to_dag_table_for_.py} | 0
...=> 0101_3_2_0_ui_improvements_for_deadlines.py} | 0
...> 0102_3_2_0_make_external_executor_id_text.py} | 0
...le.py => 0103_3_2_0_add_revoked_token_table.py} | 0
...ypes.py => 0104_3_2_0_fix_uuid_column_types.py} | 0
... => 0105_3_2_0_add_allowed_run_types_to_dag.py} | 0
...3_2_0_add_partition_key_to_backfill_dag_run.py} | 0
airflow-core/src/airflow/models/callback.py | 42 +-
airflow-core/src/airflow/models/dagbundle.py | 4 +-
airflow-core/src/airflow/models/deadline.py | 38 +-
airflow-core/src/airflow/models/deadline_alert.py | 8 +-
airflow-core/src/airflow/models/serialized_dag.py | 94 +-
airflow-core/src/airflow/models/taskinstance.py | 11 +-
airflow-core/src/airflow/observability/trace.py | 38 +-
airflow-core/src/airflow/provider.yaml.schema.json | 1 +
.../ui/openapi-gen/queries/ensureQueryData.ts | 2 +-
.../src/airflow/ui/openapi-gen/queries/prefetch.ts | 2 +-
.../src/airflow/ui/openapi-gen/queries/queries.ts | 2 +-
.../src/airflow/ui/openapi-gen/queries/suspense.ts | 2 +-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 44 +-
.../ui/openapi-gen/requests/services.gen.ts | 2 +-
.../airflow/ui/openapi-gen/requests/types.gen.ts | 28 +-
airflow-core/src/airflow/ui/package.json | 3 +-
airflow-core/src/airflow/ui/pnpm-lock.yaml | 229 +-
.../airflow/ui/public/i18n/locales/ca/admin.json | 17 +
.../airflow/ui/public/i18n/locales/ca/assets.json | 4 +-
.../airflow/ui/public/i18n/locales/ca/common.json | 9 +
.../ui/public/i18n/locales/ca/components.json | 1 +
.../src/airflow/ui/public/i18n/locales/ca/dag.json | 16 +
.../airflow/ui/public/i18n/locales/de/common.json | 7 +
.../ui/public/i18n/locales/de/components.json | 1 +
.../src/airflow/ui/public/i18n/locales/de/dag.json | 9 +
.../airflow/ui/public/i18n/locales/de/dags.json | 2 +-
.../src/airflow/ui/src/layouts/BaseLayout.tsx | 39 +-
airflow-core/src/airflow/utils/db.py | 2 +-
airflow-core/src/airflow/utils/state.py | 14 +
.../tests/unit/always/test_example_dags.py | 38 +-
.../tests/unit/always/test_project_structure.py | 2 +
.../auth/managers/simple/services/test_login.py | 5 +-
.../managers/simple/test_simple_auth_manager.py | 13 +
.../auth/managers/test_base_auth_manager.py | 30 +
.../unit/cli/commands/test_gunicorn_monitor.py | 52 +-
.../tests/unit/dag_processing/test_dagbag.py | 51 +-
.../tests/unit/executors/test_base_executor.py | 149 +
.../tests/unit/executors/test_executor_loader.py | 21 +
.../tests/unit/executors/test_local_executor.py | 43 +-
airflow-core/tests/unit/jobs/test_scheduler_job.py | 76 +-
airflow-core/tests/unit/models/test_callback.py | 8 +-
airflow-core/tests/unit/models/test_dag.py | 30 +-
.../tests/unit/models/test_deadline_alert.py | 31 +-
.../tests/unit/models/test_serialized_dag.py | 57 +-
.../unit/observability/traces/test_otel_tracer.py | 22 +-
.../unit/serialization/test_dag_serialization.py | 16 +-
airflow-ctl-tests/pyproject.toml | 9 +-
.../tests/airflowctl_tests/conftest.py | 22 +-
.../airflowctl_tests/test_airflowctl_commands.py | 56 +-
.../test_config_sensitive_masking.py | 4 +-
airflow-ctl/README.md | 3 +-
airflow-ctl/docs/howto/index.rst | 12 +-
airflow-ctl/docs/images/command_hashes.txt | 4 +-
airflow-ctl/docs/images/output_auth_login.svg | 122 +-
airflow-ctl/docs/images/output_version.svg | 88 +-
airflow-ctl/docs/installation/prerequisites.rst | 6 +-
airflow-ctl/docs/security.rst | 1 +
airflow-ctl/pyproject.toml | 9 +-
airflow-ctl/src/airflowctl/api/client.py | 42 +-
.../src/airflowctl/api/datamodels/generated.py | 2 +
airflow-ctl/src/airflowctl/ctl/cli_config.py | 45 +-
.../src/airflowctl/ctl/commands/auth_command.py | 7 +-
.../airflowctl/ctl/commands/connection_command.py | 2 +-
airflow-ctl/tests/airflow_ctl/api/test_client.py | 47 +
.../airflow_ctl/ctl/commands/test_auth_command.py | 47 +-
.../ctl/commands/test_connections_command.py | 51 +
.../airflow_ctl/ctl/commands/test_pool_command.py | 14 +-
.../tests/airflow_ctl/ctl/test_cli_config.py | 72 +-
.../airflow_ctl/ctl/test_console_formatting.py | 164 +
airflow-e2e-tests/pyproject.toml | 9 +-
chart/files/pod-template-file.kubernetes-helm-yaml | 2 +-
chart/newsfragments/61414.significant.rst | 1 +
chart/pyproject.toml | 7 +-
chart/templates/NOTES.txt | 59 +
chart/templates/api-server/api-server-ingress.yaml | 6 +-
chart/templates/flower/flower-ingress.yaml | 6 +-
chart/templates/pgbouncer/pgbouncer-ingress.yaml | 2 +-
chart/templates/statsd/statsd-ingress.yaml | 2 +-
chart/templates/webserver/webserver-ingress.yaml | 6 +-
chart/values.schema.json | 110 +-
chart/values.yaml | 25 +-
clients/python/pyproject.toml | 9 +-
.../03a_contributors_quick_start_beginners.rst | 16 +-
contributing-docs/04_how_to_contribute.rst | 127 +-
.../contributors_quick_start_codespaces.rst | 34 +
dev/README_RELEASE_AIRFLOW.md | 3 +
dev/README_RELEASE_AIRFLOWCTL.md | 1 +
dev/README_RELEASE_PROVIDERS.md | 6 +-
dev/README_RELEASE_PYTHON_CLIENT.md | 5 +-
dev/breeze/doc/10_ui_tasks.rst | 4 +-
dev/breeze/doc/11_issues_tasks.rst | 58 +
...ze_topics.rst => 12_advanced_breeze_topics.rst} | 0
dev/breeze/doc/README.rst | 3 +-
dev/breeze/doc/ci/02_images.md | 4 +-
dev/breeze/doc/images/output-commands.svg | 22 +-
dev/breeze/doc/images/output_build-docs.svg | 6 +-
dev/breeze/doc/images/output_build-docs.txt | 2 +-
dev/breeze/doc/images/output_issues.svg | 103 +
dev/breeze/doc/images/output_issues.txt | 1 +
dev/breeze/doc/images/output_issues_unassign.svg | 136 +
dev/breeze/doc/images/output_issues_unassign.txt | 1 +
...tput_release-management_add-back-references.svg | 6 +-
...tput_release-management_add-back-references.txt | 2 +-
...management_generate-issue-content-providers.svg | 20 +-
...management_generate-issue-content-providers.txt | 2 +-
...e-management_prepare-provider-distributions.svg | 20 +-
...e-management_prepare-provider-distributions.txt | 2 +-
...e-management_prepare-provider-documentation.svg | 20 +-
...e-management_prepare-provider-documentation.txt | 2 +-
.../output_release-management_publish-docs.svg | 6 +-
.../output_release-management_publish-docs.txt | 2 +-
.../output_setup_check-all-params-in-groups.svg | 10 +-
.../output_setup_check-all-params-in-groups.txt | 2 +-
.../output_setup_regenerate-command-images.svg | 22 +-
.../output_setup_regenerate-command-images.txt | 2 +-
.../images/output_workflow-run_publish-docs.svg | 6 +-
.../images/output_workflow-run_publish-docs.txt | 2 +-
dev/breeze/pyproject.toml | 6 +-
dev/breeze/src/airflow_breeze/breeze.py | 2 +
.../src/airflow_breeze/commands/issues_commands.py | 200 +
.../commands/issues_commands_config.py | 32 +-
.../commands/release_management_commands.py | 20 +-
.../src/airflow_breeze/configure_rich_click.py | 7 +
dev/breeze/src/airflow_breeze/global_constants.py | 4 +-
.../airflow_breeze/utils/check_release_files.py | 14 +-
.../airflow_breeze/utils/docker_command_utils.py | 14 +-
dev/breeze/src/airflow_breeze/utils/packages.py | 12 +-
dev/breeze/tests/test_packages.py | 4 +-
dev/breeze/tests/test_selective_checks.py | 2 +-
dev/breeze/uv.lock | 133 +-
dev/pyproject.toml | 9 +-
.../react_plugin_template/package.json | 3 +-
.../react_plugin_template/pnpm-lock.yaml | 221 +-
devel-common/pyproject.toml | 2 +-
.../src/tests_common/test_utils/providers.py | 20 +
docker-stack-docs/changelog.rst | 2 +
docker-stack-docs/pyproject.toml | 7 +-
docker-tests/pyproject.toml | 9 +-
docs/spelling_wordlist.txt | 12 +
helm-tests/pyproject.toml | 9 +-
.../airflow_aux/test_container_lifecycle.py | 28 +-
.../airflow_aux/test_pod_template_file.py | 110 +-
.../helm_tests/airflow_core/test_pdb_worker.py | 110 +-
.../tests/helm_tests/airflow_core/test_worker.py | 75 +-
.../helm_tests/airflow_core/test_worker_sets.py | 216 +-
.../helm_tests/apiserver/test_ingress_apiserver.py | 14 +-
.../helm_tests/security/test_security_context.py | 8 +-
.../helm_tests/webserver/test_ingress_flower.py | 14 +-
.../tests/helm_tests/webserver/test_ingress_web.py | 14 +-
kubernetes-tests/pyproject.toml | 9 +-
.../ai.rst} | 12 +-
providers-summary-docs/pyproject.toml | 7 +-
providers/.last_release_date.txt | 2 +-
providers/airbyte/docs/.latest-doc-only-change.txt | 2 +-
providers/airbyte/provider.yaml | 10 +
.../airflow/providers/airbyte/get_provider_info.py | 10 +
providers/alibaba/docs/.latest-doc-only-change.txt | 2 +-
providers/alibaba/provider.yaml | 51 +
.../airflow/providers/alibaba/get_provider_info.py | 26 +
providers/amazon/README.rst | 2 +-
providers/amazon/docs/changelog.rst | 23 +
providers/amazon/docs/index.rst | 2 +-
providers/amazon/pyproject.toml | 2 +-
.../amazon/aws/auth_manager/aws_auth_manager.py | 1 +
.../providers/amazon/aws/hooks/athena_sql.py | 27 +-
.../tests/unit/amazon/aws/hooks/test_athena_sql.py | 33 +
.../unit/amazon/aws/hooks/test_hooks_signature.py | 10 +-
.../amazon/aws/log/test_cloudwatch_task_handler.py | 2 +
.../unit/amazon/aws/log/test_s3_task_handler.py | 6 +
providers/apache/beam/README.rst | 24 +-
providers/apache/beam/docs/changelog.rst | 12 +
providers/apache/beam/docs/index.rst | 6 +-
providers/apache/beam/provider.yaml | 5 +-
providers/apache/beam/pyproject.toml | 6 +-
.../src/airflow/providers/apache/beam/__init__.py | 2 +-
.../cassandra/docs/.latest-doc-only-change.txt | 2 +-
providers/apache/drill/README.rst | 8 +-
providers/apache/drill/docs/changelog.rst | 12 +
providers/apache/drill/docs/index.rst | 8 +-
providers/apache/drill/provider.yaml | 3 +-
providers/apache/drill/pyproject.toml | 8 +-
.../src/airflow/providers/apache/drill/__init__.py | 2 +-
providers/apache/druid/README.rst | 19 +-
providers/apache/druid/docs/changelog.rst | 12 +
providers/apache/druid/docs/index.rst | 8 +-
providers/apache/druid/provider.yaml | 3 +-
providers/apache/druid/pyproject.toml | 8 +-
.../src/airflow/providers/apache/druid/__init__.py | 2 +-
.../apache/flink/docs/.latest-doc-only-change.txt | 2 +-
.../apache/hdfs/docs/.latest-doc-only-change.txt | 2 +-
providers/apache/hive/README.rst | 8 +-
providers/apache/hive/docs/changelog.rst | 24 +
providers/apache/hive/docs/index.rst | 8 +-
providers/apache/hive/provider.yaml | 36 +-
providers/apache/hive/pyproject.toml | 8 +-
.../src/airflow/providers/apache/hive/__init__.py | 2 +-
.../providers/apache/hive/get_provider_info.py | 19 +
.../iceberg/docs/.latest-doc-only-change.txt | 2 +-
providers/apache/iceberg/docs/connections.rst | 61 +-
providers/apache/iceberg/docs/index.rst | 7 +-
providers/apache/iceberg/provider.yaml | 1 +
providers/apache/iceberg/pyproject.toml | 9 +-
.../airflow/providers/apache/iceberg/__init__.py | 2 +-
.../providers/apache/iceberg/hooks/iceberg.py | 209 +-
.../tests/system/apache/iceberg/example_iceberg.py | 6 +-
.../unit/apache/iceberg/hooks/test_iceberg.py | 535 ++-
providers/apache/impala/README.rst | 10 +-
providers/apache/impala/docs/changelog.rst | 17 +
providers/apache/impala/docs/index.rst | 8 +-
providers/apache/impala/provider.yaml | 3 +-
providers/apache/impala/pyproject.toml | 8 +-
.../airflow/providers/apache/impala/__init__.py | 2 +-
.../apache/kafka/docs/.latest-doc-only-change.txt | 2 +-
.../apache/kylin/docs/.latest-doc-only-change.txt | 2 +-
.../apache/livy/docs/.latest-doc-only-change.txt | 2 +-
.../apache/pig/docs/.latest-doc-only-change.txt | 2 +-
providers/apache/pinot/README.rst | 8 +-
providers/apache/pinot/docs/changelog.rst | 12 +
providers/apache/pinot/docs/index.rst | 8 +-
providers/apache/pinot/provider.yaml | 3 +-
providers/apache/pinot/pyproject.toml | 8 +-
.../src/airflow/providers/apache/pinot/__init__.py | 2 +-
providers/apache/spark/README.rst | 8 +-
providers/apache/spark/docs/changelog.rst | 13 +
providers/apache/spark/docs/index.rst | 6 +-
providers/apache/spark/provider.yaml | 85 +-
providers/apache/spark/pyproject.toml | 6 +-
.../src/airflow/providers/apache/spark/__init__.py | 2 +-
.../providers/apache/spark/get_provider_info.py | 47 +
.../tinkerpop/docs/.latest-doc-only-change.txt | 2 +-
providers/apprise/docs/.latest-doc-only-change.txt | 2 +-
.../arangodb/docs/.latest-doc-only-change.txt | 2 +-
providers/asana/docs/.latest-doc-only-change.txt | 2 +-
.../jira/docs/.latest-doc-only-change.txt | 2 +-
providers/celery/README.rst | 6 +-
providers/celery/docs/changelog.rst | 22 +
providers/celery/docs/index.rst | 6 +-
providers/celery/provider.yaml | 3 +-
providers/celery/pyproject.toml | 6 +-
.../src/airflow/providers/celery/__init__.py | 2 +-
.../providers/celery/executors/celery_executor.py | 56 +-
.../celery/executors/celery_executor_utils.py | 55 +-
.../celery/executors/celery_kubernetes_executor.py | 12 +-
.../integration/celery/test_celery_executor.py | 7 +-
.../cloudant/docs/.latest-doc-only-change.txt | 2 +-
providers/cncf/kubernetes/README.rst | 6 +-
providers/cncf/kubernetes/docs/changelog.rst | 25 +
providers/cncf/kubernetes/docs/index.rst | 6 +-
providers/cncf/kubernetes/provider.yaml | 3 +-
providers/cncf/kubernetes/pyproject.toml | 6 +-
.../airflow/providers/cncf/kubernetes/__init__.py | 2 +-
.../executors/local_kubernetes_executor.py | 8 +-
providers/cohere/docs/.latest-doc-only-change.txt | 2 +-
providers/cohere/provider.yaml | 4 +
.../airflow/providers/cohere/get_provider_info.py | 4 +
.../common/ai/docs/connections/pydantic_ai.rst | 114 +
providers/common/ai/docs/hooks/pydantic_ai.rst | 68 +
providers/common/ai/docs/index.rst | 51 +-
.../ai}/docs/operators/index.rst | 2 +-
providers/common/ai/docs/operators/llm.rst | 120 +
providers/common/ai/docs/operators/llm_sql.rst | 134 +
providers/common/ai/provider.yaml | 44 +-
providers/common/ai/pyproject.toml | 23 +
.../providers/common/ai/decorators}/__init__.py | 0
.../airflow/providers/common/ai/decorators/llm.py | 133 +
.../providers/common/ai/decorators/llm_sql.py | 126 +
.../providers/common/ai/example_dags}/__init__.py | 0
.../common/ai/example_dags/example_llm.py | 116 +
.../example_dags/example_llm_analysis_pipeline.py | 81 +
.../ai/example_dags/example_llm_classification.py | 53 +
.../common/ai/example_dags/example_llm_sql.py | 126 +
.../ai/example_dags/example_pydantic_ai_hook.py | 67 +
.../providers/common/ai/get_provider_info.py | 51 +-
.../airflow/providers/common/ai/hooks}/__init__.py | 0
.../providers/common/ai/hooks/pydantic_ai.py | 166 +
.../providers/common/ai/operators}/__init__.py | 0
.../airflow/providers/common/ai/operators/llm.py | 99 +
.../providers/common/ai/operators/llm_sql.py | 234 +
.../airflow/providers/common/ai/utils}/__init__.py | 0
.../providers/common/ai/utils/sql_validation.py | 100 +
.../tests/unit/common/ai/decorators}/__init__.py | 0
.../ai/tests/unit/common/ai/decorators/test_llm.py | 85 +
.../unit/common/ai/decorators/test_llm_sql.py | 84 +
.../ai/tests/unit/common/ai/hooks}/__init__.py | 0
.../tests/unit/common/ai/hooks/test_pydantic_ai.py | 298 ++
.../ai/tests/unit/common/ai/operators}/__init__.py | 0
.../ai/tests/unit/common/ai/operators/test_llm.py | 79 +
.../tests/unit/common/ai/operators/test_llm_sql.py | 416 ++
.../common/ai/tests/unit/common/ai/test_empty.py | 23 -
.../ai/tests/unit/common/ai/utils}/__init__.py | 0
.../unit/common/ai/utils/test_sql_validation.py | 161 +
providers/common/compat/README.rst | 6 +-
providers/common/compat/docs/changelog.rst | 12 +
providers/common/compat/docs/index.rst | 6 +-
providers/common/compat/provider.yaml | 3 +-
providers/common/compat/pyproject.toml | 6 +-
.../airflow/providers/common/compat/__init__.py | 2 +-
.../common/io/docs/.latest-doc-only-change.txt | 2 +-
.../messaging/docs/.latest-doc-only-change.txt | 2 +-
providers/common/sql/docs/changelog.rst | 7 +
providers/common/sql/docs/index.rst | 3 +-
providers/common/sql/docs/operators.rst | 76 +
providers/common/sql/provider.yaml | 3 +
providers/common/sql/pyproject.toml | 10 +-
.../sql/src/airflow/providers/common/sql/config.py | 86 +
.../providers/common/sql/datafusion}/__init__.py | 0
.../providers/common/sql/datafusion/base.py | 67 +
.../providers/common/sql/datafusion/engine.py | 172 +
.../providers/common/sql/datafusion}/exceptions.py | 13 +-
.../common/sql/datafusion/format_handlers.py | 113 +
.../sql/datafusion/object_storage_provider.py | 87 +
.../common/sql/decorators/{sql.py => analytics.py} | 45 +-
.../providers/common/sql/example_dags}/__init__.py | 0
.../common/sql/example_dags/example_analytics.py | 67 +
.../providers/common/sql/get_provider_info.py | 7 +-
.../src/airflow/providers/common/sql/hooks/sql.py | 13 +-
.../src/airflow/providers/common/sql/hooks/sql.pyi | 2 +-
.../providers/common/sql/operators/analytics.py | 161 +
.../tests/unit/common/sql/datafusion}/__init__.py | 0
.../unit/common/sql/datafusion/test_engine.py | 295 ++
.../common/sql/datafusion/test_format_handlers.py | 82 +
.../sql/datafusion/test_object_storage_provider.py | 74 +
.../unit/common/sql/decorators/test_analytics.py | 122 +
.../sql/tests/unit/common/sql/hooks/test_sql.py | 48 +-
.../unit/common/sql/operators/test_analytics.py | 159 +
.../common/sql/operators/test_generic_transfer.py | 4 +-
.../sql/tests/unit/common/sql/test_config.py | 79 +
providers/databricks/README.rst | 8 +-
providers/databricks/docs/changelog.rst | 16 +
providers/databricks/docs/index.rst | 8 +-
providers/databricks/provider.yaml | 3 +-
providers/databricks/pyproject.toml | 8 +-
.../src/airflow/providers/databricks/__init__.py | 2 +-
providers/datadog/docs/.latest-doc-only-change.txt | 2 +-
providers/dbt/cloud/README.rst | 6 +-
providers/dbt/cloud/docs/changelog.rst | 12 +
providers/dbt/cloud/docs/index.rst | 6 +-
providers/dbt/cloud/provider.yaml | 3 +-
providers/dbt/cloud/pyproject.toml | 6 +-
.../src/airflow/providers/dbt/cloud/__init__.py | 2 +-
.../src/airflow/providers/dbt/cloud/hooks/dbt.py | 65 +-
.../airflow/providers/dbt/cloud/operators/dbt.py | 16 +-
.../cloud/tests/unit/dbt/cloud/hooks/test_dbt.py | 83 +-
.../tests/unit/dbt/cloud/operators/test_dbt.py | 2 +-
.../dingding/docs/.latest-doc-only-change.txt | 2 +-
providers/discord/docs/.latest-doc-only-change.txt | 2 +-
providers/docker/docs/.latest-doc-only-change.txt | 2 +-
.../airflow/providers/docker/operators/docker.py | 2 +-
providers/edge3/README.rst | 8 +-
providers/edge3/docs/changelog.rst | 32 +
providers/edge3/docs/index.rst | 8 +-
providers/edge3/provider.yaml | 3 +-
providers/edge3/pyproject.toml | 21 +-
.../edge3/src/airflow/providers/edge3/__init__.py | 2 +-
.../edge3/src/airflow/providers/edge3/models/db.py | 6 +-
.../providers/edge3/plugins/www/package.json | 3 +-
.../providers/edge3/plugins/www/pnpm-lock.yaml | 221 +-
.../edge3/worker_api/v2-edge-generated.yaml | 6 +-
providers/elasticsearch/README.rst | 2 +-
providers/elasticsearch/docs/changelog.rst | 1 +
.../providers/elasticsearch/log/es_task_handler.py | 3 +-
.../unit/elasticsearch/log/test_es_task_handler.py | 6 +
providers/exasol/README.rst | 8 +-
providers/exasol/docs/changelog.rst | 17 +
providers/exasol/docs/index.rst | 8 +-
providers/exasol/provider.yaml | 3 +-
providers/exasol/pyproject.toml | 8 +-
.../src/airflow/providers/exasol/__init__.py | 2 +-
providers/fab/README.rst | 6 +-
providers/fab/docs/changelog.rst | 40 +
providers/fab/docs/index.rst | 6 +-
providers/fab/provider.yaml | 3 +-
providers/fab/pyproject.toml | 19 +-
.../fab/src/airflow/providers/fab/__init__.py | 2 +-
.../facebook/docs/.latest-doc-only-change.txt | 2 +-
providers/ftp/docs/.latest-doc-only-change.txt | 2 +-
providers/git/README.rst | 6 +-
providers/git/docs/changelog.rst | 13 +
providers/git/docs/index.rst | 6 +-
providers/git/provider.yaml | 3 +-
providers/git/pyproject.toml | 6 +-
.../git/src/airflow/providers/git/__init__.py | 2 +-
providers/github/docs/.latest-doc-only-change.txt | 2 +-
providers/google/README.rst | 15 +-
providers/google/docs/changelog.rst | 33 +-
providers/google/docs/index.rst | 4 +-
providers/google/pyproject.toml | 8 +-
.../providers/google/cloud/operators/dataproc.py | 6 +
.../google/cloud/transfers/gdrive_to_gcs.py | 7 +-
.../google/cloud/transfers/sheets_to_gcs.py | 22 +-
.../providers/google/cloud/triggers/dataproc.py | 8 +-
.../dataproc/example_dataproc_cluster_generator.py | 1 +
.../google/cloud/dataproc/example_dataproc_hive.py | 1 +
.../google/cloud/dataproc/example_dataproc_pig.py | 1 +
.../cloud/dataproc/example_dataproc_pyspark.py | 1 +
.../tests/unit/google/cloud/hooks/test_dataflow.py | 5 +
.../unit/google/cloud/log/test_gcs_task_handler.py | 8 +
.../unit/google/cloud/operators/test_dataflow.py | 4 +
.../google/cloud/operators/test_datapipeline.py | 3 +
.../unit/google/cloud/operators/test_dataproc.py | 7 +
.../unit/google/cloud/sensors/test_dataflow.py | 3 +
.../google/cloud/transfers/test_gdrive_to_gcs.py | 4 +-
.../google/cloud/transfers/test_sheets_to_gcs.py | 73 +-
.../unit/google/cloud/triggers/test_dataflow.py | 4 +
.../unit/google/cloud/triggers/test_dataproc.py | 17 +-
.../utils/test_mlengine_prediction_summary.py | 4 +
providers/grpc/docs/.latest-doc-only-change.txt | 2 +-
.../hashicorp/docs/.latest-doc-only-change.txt | 2 +-
providers/http/README.rst | 6 +-
providers/http/docs/changelog.rst | 8 +
providers/imap/docs/.latest-doc-only-change.txt | 2 +-
.../influxdb/docs/.latest-doc-only-change.txt | 2 +-
providers/informatica/README.rst | 216 +-
providers/informatica/docs/commits.rst | 19 +-
providers/jdbc/README.rst | 10 +-
providers/jdbc/docs/changelog.rst | 18 +
providers/jdbc/docs/index.rst | 10 +-
providers/jdbc/provider.yaml | 9 +-
providers/jdbc/pyproject.toml | 10 +-
.../jdbc/src/airflow/providers/jdbc/__init__.py | 2 +-
.../airflow/providers/jdbc/get_provider_info.py | 9 +-
providers/jenkins/docs/.latest-doc-only-change.txt | 2 +-
providers/jenkins/provider.yaml | 17 +
.../airflow/providers/jenkins/get_provider_info.py | 17 +
providers/keycloak/README.rst | 6 +-
providers/keycloak/docs/changelog.rst | 22 +
providers/keycloak/docs/index.rst | 6 +-
providers/keycloak/provider.yaml | 3 +-
providers/keycloak/pyproject.toml | 6 +-
.../src/airflow/providers/keycloak/__init__.py | 2 +-
providers/microsoft/azure/README.rst | 32 +-
providers/microsoft/azure/docs/changelog.rst | 5 +
providers/microsoft/mssql/README.rst | 8 +-
providers/microsoft/mssql/docs/changelog.rst | 12 +
providers/microsoft/mssql/docs/index.rst | 8 +-
providers/microsoft/mssql/provider.yaml | 3 +-
providers/microsoft/mssql/pyproject.toml | 8 +-
.../airflow/providers/microsoft/mssql/__init__.py | 2 +-
.../psrp/docs/.latest-doc-only-change.txt | 2 +-
providers/microsoft/winrm/README.rst | 8 +-
providers/microsoft/winrm/docs/changelog.rst | 12 +
providers/microsoft/winrm/docs/index.rst | 6 +-
providers/microsoft/winrm/provider.yaml | 3 +-
providers/microsoft/winrm/pyproject.toml | 6 +-
.../airflow/providers/microsoft/winrm/__init__.py | 2 +-
providers/mongo/docs/.latest-doc-only-change.txt | 2 +-
providers/mongo/provider.yaml | 25 +
.../airflow/providers/mongo/get_provider_info.py | 14 +-
providers/mysql/README.rst | 8 +-
providers/mysql/docs/changelog.rst | 12 +
providers/mysql/docs/index.rst | 8 +-
providers/mysql/provider.yaml | 3 +-
providers/mysql/pyproject.toml | 8 +-
.../mysql/src/airflow/providers/mysql/__init__.py | 2 +-
.../mysql/tests/unit/mysql/hooks/test_mysql.py | 4 +-
providers/neo4j/docs/.latest-doc-only-change.txt | 2 +-
providers/odbc/README.rst | 10 +-
providers/odbc/docs/changelog.rst | 12 +
providers/odbc/docs/index.rst | 8 +-
providers/odbc/provider.yaml | 3 +-
providers/odbc/pyproject.toml | 8 +-
.../odbc/src/airflow/providers/odbc/__init__.py | 2 +-
providers/openai/docs/.latest-doc-only-change.txt | 2 +-
.../openfaas/docs/.latest-doc-only-change.txt | 2 +-
providers/openlineage/README.rst | 10 +-
providers/openlineage/docs/changelog.rst | 23 +
providers/openlineage/docs/index.rst | 10 +-
providers/openlineage/provider.yaml | 3 +-
providers/openlineage/pyproject.toml | 10 +-
.../src/airflow/providers/openlineage/__init__.py | 2 +-
.../opensearch/docs/.latest-doc-only-change.txt | 2 +-
.../unit/opensearch/log/test_os_task_handler.py | 6 +
.../opsgenie/docs/.latest-doc-only-change.txt | 2 +-
providers/oracle/README.rst | 8 +-
providers/oracle/docs/changelog.rst | 12 +
providers/oracle/docs/index.rst | 8 +-
providers/oracle/provider.yaml | 3 +-
providers/oracle/pyproject.toml | 8 +-
.../src/airflow/providers/oracle/__init__.py | 2 +-
.../pagerduty/docs/.latest-doc-only-change.txt | 2 +-
.../papermill/docs/.latest-doc-only-change.txt | 2 +-
providers/pgvector/README.rst | 8 +-
providers/pgvector/docs/changelog.rst | 12 +
providers/pgvector/docs/index.rst | 8 +-
providers/pgvector/provider.yaml | 3 +-
providers/pgvector/pyproject.toml | 8 +-
.../src/airflow/providers/pgvector/__init__.py | 2 +-
.../pinecone/docs/.latest-doc-only-change.txt | 2 +-
providers/postgres/README.rst | 8 +-
providers/postgres/docs/changelog.rst | 18 +
providers/postgres/docs/index.rst | 8 +-
providers/postgres/provider.yaml | 6 +-
providers/postgres/pyproject.toml | 8 +-
.../src/airflow/providers/postgres/__init__.py | 2 +-
.../providers/postgres/get_provider_info.py | 1 +
providers/presto/README.rst | 10 +-
providers/presto/docs/changelog.rst | 17 +
providers/presto/docs/index.rst | 8 +-
providers/presto/provider.yaml | 3 +-
providers/presto/pyproject.toml | 8 +-
.../src/airflow/providers/presto/__init__.py | 2 +-
providers/qdrant/README.rst | 14 +-
providers/qdrant/docs/changelog.rst | 12 +
providers/qdrant/docs/index.rst | 6 +-
providers/qdrant/provider.yaml | 3 +-
providers/qdrant/pyproject.toml | 6 +-
.../src/airflow/providers/qdrant/__init__.py | 2 +-
providers/redis/docs/.latest-doc-only-change.txt | 2 +-
.../salesforce/docs/.latest-doc-only-change.txt | 2 +-
providers/salesforce/provider.yaml | 85 +
.../providers/salesforce/get_provider_info.py | 30 +
providers/samba/docs/.latest-doc-only-change.txt | 2 +-
providers/samba/provider.yaml | 15 +
.../airflow/providers/samba/get_provider_info.py | 13 +-
providers/segment/docs/.latest-doc-only-change.txt | 2 +-
.../sendgrid/docs/.latest-doc-only-change.txt | 2 +-
providers/sftp/docs/.latest-doc-only-change.txt | 2 +-
.../singularity/docs/.latest-doc-only-change.txt | 2 +-
providers/slack/README.rst | 6 +-
providers/slack/docs/changelog.rst | 13 +
providers/slack/docs/index.rst | 6 +-
providers/slack/provider.yaml | 3 +-
providers/slack/pyproject.toml | 6 +-
.../slack/src/airflow/providers/slack/__init__.py | 2 +-
providers/smtp/docs/.latest-doc-only-change.txt | 2 +-
providers/snowflake/README.rst | 8 +-
providers/snowflake/docs/changelog.rst | 15 +
providers/snowflake/docs/index.rst | 8 +-
providers/snowflake/provider.yaml | 3 +-
providers/snowflake/pyproject.toml | 8 +-
.../src/airflow/providers/snowflake/__init__.py | 2 +-
providers/sqlite/README.rst | 8 +-
providers/sqlite/docs/changelog.rst | 12 +
providers/sqlite/docs/index.rst | 8 +-
providers/sqlite/provider.yaml | 3 +-
providers/sqlite/pyproject.toml | 8 +-
.../src/airflow/providers/sqlite/__init__.py | 2 +-
providers/ssh/docs/.latest-doc-only-change.txt | 2 +-
providers/standard/README.rst | 6 +-
providers/standard/docs/changelog.rst | 18 +
providers/standard/docs/index.rst | 6 +-
providers/standard/provider.yaml | 3 +-
providers/standard/pyproject.toml | 6 +-
.../src/airflow/providers/standard/__init__.py | 2 +-
providers/tableau/docs/.latest-doc-only-change.txt | 2 +-
.../telegram/docs/.latest-doc-only-change.txt | 2 +-
providers/teradata/README.rst | 8 +-
providers/teradata/docs/changelog.rst | 17 +
providers/teradata/docs/index.rst | 8 +-
providers/teradata/provider.yaml | 3 +-
providers/teradata/pyproject.toml | 8 +-
.../src/airflow/providers/teradata/__init__.py | 2 +-
providers/trino/README.rst | 10 +-
providers/trino/docs/changelog.rst | 13 +
providers/trino/docs/index.rst | 8 +-
providers/trino/provider.yaml | 27 +-
providers/trino/pyproject.toml | 8 +-
.../trino/src/airflow/providers/trino/__init__.py | 2 +-
.../airflow/providers/trino/get_provider_info.py | 11 +-
providers/vertica/README.rst | 10 +-
providers/vertica/docs/changelog.rst | 18 +
providers/vertica/docs/index.rst | 8 +-
providers/vertica/provider.yaml | 3 +-
providers/vertica/pyproject.toml | 8 +-
.../src/airflow/providers/vertica/__init__.py | 2 +-
.../weaviate/docs/.latest-doc-only-change.txt | 2 +-
providers/yandex/docs/.latest-doc-only-change.txt | 2 +-
providers/yandex/docs/index.rst | 2 +-
providers/yandex/pyproject.toml | 2 +-
providers/ydb/README.rst | 8 +-
providers/ydb/docs/changelog.rst | 12 +
providers/ydb/docs/index.rst | 8 +-
providers/ydb/provider.yaml | 3 +-
providers/ydb/pyproject.toml | 8 +-
.../ydb/src/airflow/providers/ydb/__init__.py | 2 +-
providers/zendesk/docs/.latest-doc-only-change.txt | 2 +-
pyproject.toml | 23 +-
scripts/ci/prek/check_extra_packages_ref.py | 2 +-
scripts/ci/prek/check_imports_in_providers.py | 2 +-
.../prek/check_shared_distributions_structure.py | 2 +-
scripts/ci/prek/common_prek_utils.py | 8 +-
scripts/ci/prek/ruff_format.py | 2 +-
scripts/ci/prek/update_airflow_pyproject_toml.py | 3 +-
scripts/ci/prek/upgrade_important_versions.py | 192 +
.../in_container/run_provider_yaml_files_check.py | 18 +
scripts/in_container/verify_providers.py | 14 +
scripts/tools/setup_breeze | 2 +-
shared/configuration/pyproject.toml | 9 +-
.../src/airflow_shared/configuration/parser.py | 6 +
.../tests/configuration/test_parser.py | 119 +
shared/dagnode/pyproject.toml | 9 +-
shared/listeners/pyproject.toml | 9 +-
shared/logging/pyproject.toml | 9 +-
shared/module_loading/pyproject.toml | 9 +-
shared/observability/pyproject.toml | 9 +-
shared/plugins_manager/pyproject.toml | 9 +-
shared/providers_discovery/pyproject.toml | 9 +-
shared/secrets_backend/pyproject.toml | 9 +-
shared/secrets_masker/pyproject.toml | 9 +-
shared/timezones/pyproject.toml | 9 +-
task-sdk-integration-tests/pyproject.toml | 9 +-
task-sdk/.pre-commit-config.yaml | 23 +-
task-sdk/pyproject.toml | 9 +-
task-sdk/src/airflow/sdk/bases/operator.py | 8 +-
task-sdk/src/airflow/sdk/definitions/connection.py | 35 +-
task-sdk/src/airflow/sdk/definitions/deadline.py | 4 +-
.../src/airflow/sdk/definitions/mappedoperator.py | 6 +-
.../src/airflow/sdk/execution_time/supervisor.py | 25 +-
task-sdk/src/airflow/sdk/observability/trace.py | 38 +-
task-sdk/src/airflow/sdk/types.py | 17 +
.../tests/task_sdk/definitions/test_connection.py | 14 +
.../tests/task_sdk/definitions/test_deadline.py | 23 +-
.../task_sdk/execution_time/test_supervisor.py | 88 +
688 files changed, 16986 insertions(+), 5455 deletions(-)
create mode 100644 .github/skills/airflow-translations/locales/fr.md
create mode 100644 .github/skills/airflow-translations/locales/th.md
delete mode 100644 airflow-core/src/airflow/executors/workloads.py
copy airflow-core/src/airflow/{api_fastapi/core_api/datamodels/extra_links.py
=> executors/workloads/__init__.py} (62%)
create mode 100644 airflow-core/src/airflow/executors/workloads/base.py
create mode 100644 airflow-core/src/airflow/executors/workloads/callback.py
create mode 100644 airflow-core/src/airflow/executors/workloads/task.py
copy airflow-core/src/airflow/{api_fastapi/core_api/datamodels/ui/calendar.py
=> executors/workloads/trigger.py} (53%)
create mode 100644 airflow-core/src/airflow/executors/workloads/types.py
copy
airflow-core/src/airflow/migrations/versions/{0051_3_0_0_update_task_instance_trigger_timeout_to_utcdatetime.py
=> 0087_3_1_8_change_signed_url_template_from_varchar_.py} (55%)
rename
airflow-core/src/airflow/migrations/versions/{0087_3_2_0_replace_asset_trigger_table_with_asset.py
=> 0088_3_2_0_replace_asset_trigger_table_with_asset.py} (98%)
rename
airflow-core/src/airflow/migrations/versions/{0088_3_2_0_change_serialized_dag_data_column_to_jsonb.py
=> 0089_3_2_0_change_serialized_dag_data_column_to_jsonb.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0089_3_2_0_add_length_dag_bundle_team_bundle_name.py
=> 0090_3_2_0_add_length_dag_bundle_team_bundle_name.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0090_3_2_0_add_human_in_the_loop_detail_history.py
=> 0091_3_2_0_add_human_in_the_loop_detail_history.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0091_3_2_0_add_fail_fast_to_dag_table.py
=> 0092_3_2_0_add_fail_fast_to_dag_table.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0092_3_2_0_restructure_callback_table.py
=> 0093_3_2_0_restructure_callback_table.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0093_3_2_0_replace_deadline_inline_callback_with_fkey.py
=> 0094_3_2_0_replace_deadline_inline_callback_with_fkey.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0094_3_2_0_update_orm_asset_partitioning.py
=> 0095_3_2_0_update_orm_asset_partitioning.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0095_3_2_0_remove_team_id.py =>
0096_3_2_0_remove_team_id.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0096_3_2_0_enforce_log_event_and_dag_is_stale_not_null.py
=> 0097_3_2_0_enforce_log_event_and_dag_is_stale_not_null.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0097_3_2_0_add_queue_column_to_trigger.py
=> 0098_3_2_0_add_queue_column_to_trigger.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0098_3_2_0_add_exceeds_max_runs_flag_to_dag_model.py
=> 0099_3_2_0_add_exceeds_max_runs_flag_to_dag_model.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0099_3_2_0_add_timetable_type_to_dag_table_for_.py
=> 0100_3_2_0_add_timetable_type_to_dag_table_for_.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0100_3_2_0_ui_improvements_for_deadlines.py
=> 0101_3_2_0_ui_improvements_for_deadlines.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0101_3_2_0_make_external_executor_id_text.py
=> 0102_3_2_0_make_external_executor_id_text.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0102_3_2_0_add_revoked_token_table.py
=> 0103_3_2_0_add_revoked_token_table.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0103_3_2_0_fix_uuid_column_types.py
=> 0104_3_2_0_fix_uuid_column_types.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0104_3_2_0_add_allowed_run_types_to_dag.py
=> 0105_3_2_0_add_allowed_run_types_to_dag.py} (100%)
rename
airflow-core/src/airflow/migrations/versions/{0105_3_2_0_add_partition_key_to_backfill_dag_run.py
=> 0106_3_2_0_add_partition_key_to_backfill_dag_run.py} (100%)
mode change 100644 => 100755 airflow-ctl/src/airflowctl/ctl/cli_config.py
create mode 100644 airflow-ctl/tests/airflow_ctl/ctl/test_console_formatting.py
create mode 100644 chart/newsfragments/61414.significant.rst
create mode 100644 dev/breeze/doc/11_issues_tasks.rst
rename dev/breeze/doc/{11_advanced_breeze_topics.rst =>
12_advanced_breeze_topics.rst} (100%)
create mode 100644 dev/breeze/doc/images/output_issues.svg
create mode 100644 dev/breeze/doc/images/output_issues.txt
create mode 100644 dev/breeze/doc/images/output_issues_unassign.svg
create mode 100644 dev/breeze/doc/images/output_issues_unassign.txt
create mode 100644 dev/breeze/src/airflow_breeze/commands/issues_commands.py
copy airflow-core/tests/unit/utils/test_strings.py =>
dev/breeze/src/airflow_breeze/commands/issues_commands_config.py (64%)
copy providers-summary-docs/{core-extensions/deferrable-operator-ref.rst =>
operators-and-hooks-ref/ai.rst} (83%)
create mode 100644 providers/common/ai/docs/connections/pydantic_ai.rst
create mode 100644 providers/common/ai/docs/hooks/pydantic_ai.rst
copy providers/{teradata => common/ai}/docs/operators/index.rst (97%)
create mode 100644 providers/common/ai/docs/operators/llm.rst
create mode 100644 providers/common/ai/docs/operators/llm_sql.rst
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/src/airflow/providers/common/ai/decorators}/__init__.py
(100%)
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/decorators/llm.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/decorators/llm_sql.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/src/airflow/providers/common/ai/example_dags}/__init__.py
(100%)
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_llm.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_llm_analysis_pipeline.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_llm_classification.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_llm_sql.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/example_dags/example_pydantic_ai_hook.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/src/airflow/providers/common/ai/hooks}/__init__.py (100%)
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/hooks/pydantic_ai.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/src/airflow/providers/common/ai/operators}/__init__.py
(100%)
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/operators/llm.py
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/operators/llm_sql.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/src/airflow/providers/common/ai/utils}/__init__.py (100%)
create mode 100644
providers/common/ai/src/airflow/providers/common/ai/utils/sql_validation.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/tests/unit/common/ai/decorators}/__init__.py (100%)
create mode 100644
providers/common/ai/tests/unit/common/ai/decorators/test_llm.py
create mode 100644
providers/common/ai/tests/unit/common/ai/decorators/test_llm_sql.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/tests/unit/common/ai/hooks}/__init__.py (100%)
create mode 100644
providers/common/ai/tests/unit/common/ai/hooks/test_pydantic_ai.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/tests/unit/common/ai/operators}/__init__.py (100%)
create mode 100644
providers/common/ai/tests/unit/common/ai/operators/test_llm.py
create mode 100644
providers/common/ai/tests/unit/common/ai/operators/test_llm_sql.py
delete mode 100644 providers/common/ai/tests/unit/common/ai/test_empty.py
copy {airflow-core/src/airflow/_shared =>
providers/common/ai/tests/unit/common/ai/utils}/__init__.py (100%)
create mode 100644
providers/common/ai/tests/unit/common/ai/utils/test_sql_validation.py
create mode 100644
providers/common/sql/src/airflow/providers/common/sql/config.py
copy {airflow-core/src/airflow/_shared =>
providers/common/sql/src/airflow/providers/common/sql/datafusion}/__init__.py
(100%)
create mode 100644
providers/common/sql/src/airflow/providers/common/sql/datafusion/base.py
create mode 100644
providers/common/sql/src/airflow/providers/common/sql/datafusion/engine.py
copy providers/{openai/src/airflow/providers/openai =>
common/sql/src/airflow/providers/common/sql/datafusion}/exceptions.py (74%)
create mode 100644
providers/common/sql/src/airflow/providers/common/sql/datafusion/format_handlers.py
create mode 100644
providers/common/sql/src/airflow/providers/common/sql/datafusion/object_storage_provider.py
copy providers/common/sql/src/airflow/providers/common/sql/decorators/{sql.py
=> analytics.py} (70%)
copy {airflow-core/src/airflow/_shared =>
providers/common/sql/src/airflow/providers/common/sql/example_dags}/__init__.py
(100%)
create mode 100644
providers/common/sql/src/airflow/providers/common/sql/example_dags/example_analytics.py
create mode 100644
providers/common/sql/src/airflow/providers/common/sql/operators/analytics.py
copy {airflow-core/src/airflow/_shared =>
providers/common/sql/tests/unit/common/sql/datafusion}/__init__.py (100%)
create mode 100644
providers/common/sql/tests/unit/common/sql/datafusion/test_engine.py
create mode 100644
providers/common/sql/tests/unit/common/sql/datafusion/test_format_handlers.py
create mode 100644
providers/common/sql/tests/unit/common/sql/datafusion/test_object_storage_provider.py
create mode 100644
providers/common/sql/tests/unit/common/sql/decorators/test_analytics.py
create mode 100644
providers/common/sql/tests/unit/common/sql/operators/test_analytics.py
create mode 100644 providers/common/sql/tests/unit/common/sql/test_config.py
