This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch breeze-install-from-lock
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard b14995d939b Run breeze from the locked dev/breeze environment
add 36016dfbe2f Add Redis cluster mode support to RedisHook (#71067)
add 00344cc117f Remove TaskFlow recommendation in doc part2 (#72090)
add 8e14c2960eb Cut the per-file cost of persisting Dag parse results
(#71621)
add dcb63a488b9 Rename Legacy{Foo} to TeamUnaware{Foo} where appropriate
(#72044)
add fc6c8b1b7ca Check Variable write conflicts against the team being
written (#72042)
add f727ea8544d Fix stale TypeScript SDK docs on bundle metadata and
packing setup (#72115)
add 49a129a45ec Complete the Taiwanese Mandarin UI translations (#72056)
add a2ab8e81ce1 Fix flaky test_connection_form_widgets timeout (#72122)
add 5a7118bad78 Clarify to agents that inter provider versions must not be
bumped (#72142)
add 6f78320a8c4 Sync connection UI metadata in provider.yaml with hook
definitions (#72087)
add ecf2842c30f Change google sheets operator and connected system tests
(#66929)
add 56f6db03a14 Add destination_folder_id to GCSToGoogleDriveOperator
templated fields and update google drive system tests (#66930)
add 2c8925e33af Fix cloudsql query proxy iam system test (#72141)
add 49c1e07e3f7 Honor impersonation_chain in deferred Cloud Build tasks
(#71644)
add 1e0f48ce6d0 Support bzip2 and xz compressed inputs in LLM file
analysis (#70302)
add 8dad501a086 Fix multiple client creation inside of the deferrable
operator for the google provider (#72143)
add 14fd8202a5b Honor gzip and mime_type on SFTPToGCS stream path (#72132)
add 44ea07505c6 Skip downstream tasks on LLMBranchOperator reject (#71073)
add dd6d28df3ec i18n(ko): add missing translations(Aug 25) (#72050)
add 562e7307c2c Fix N+1 query in bulk update for Variables and Pools
(#71918)
add 5a7a4bc19b4 Migrate exasol provider to pyexasol 2.x and remove the <2
cap (#72119)
add 02dbd2f6170 Stop backfill endpoints disclosing ids across Dags you
cannot see (#71113)
add d868c8c7144 Make breeze setup recover from a broken legacy uv tool
install (#72059)
add b294df20c32 Be specific on how to create the PyPI token for a provider
release (#72170)
add a26f17fcef4 Document the access a first-time provider release manager
must request (#72169)
add e6691964993 Derive the testing issue title date from RELEASE_DATE
(#72168)
add ee15456649a Clean up comments and tests for the Dag version inflation
checker (#72028)
add 1e6ff912bfc Fill in missing zh-TW translations for common.json (#72154)
add 3d4216a7c1f Fix common.ai Vertex model example to use a valid
pydantic-ai prefix (#72011)
add 6171e2bf992 Remove the unreachable 404 from the create Variable
endpoint (#71245)
add 51ebe32acc1 Stop Breeze container SSH setup from modifying the host
~/.ssh (#72182)
add 9da89e70ac0 Feature expand health endpoint reporting (#70416)
add dca333a6484 Write doc-only marker when change classification overrides
the answer (#72167)
add 62ecde055c8 Reduce Iceberg snapshot watcher thread use (#72173)
add da2d9fde79c Document the missing resource category in common.ai retry
policy docs (#72189)
add 2d82de6f374 Change edge worker heartbeat message from info to debug
(#72197)
add db815a56abb Refactor bigquery_async_query test (#72193)
add 66b942ed2d9 [main] CI: Upgrade important CI environment (#72091)
add fdb8594e6bf Fix /ui/assets picking a stale "last event" under
concurrent asset writes (#71047)
add 9d54ac94826 Fix docs spellcheck failure in the IBM Db2 provider
(#72203)
add 790126def2e Run breeze from the locked dev/breeze environment
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (b14995d939b)
\
N -- N -- N refs/heads/breeze-install-from-lock (790126def2e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.pre-commit-config.yaml | 2 +-
Dockerfile.ci | 42 +-
.../logging-monitoring/check-health.rst | 100 +++--
.../language-sdks/typescript.rst | 13 +-
airflow-core/docs/best-practices.rst | 2 +-
airflow-core/docs/core-concepts/dags.rst | 2 +-
airflow-core/docs/migrations-ref.rst | 4 +-
airflow-core/newsfragments/71113.significant.rst | 23 +
airflow-core/newsfragments/72042.bugfix.rst | 1 +
.../src/airflow/api/common/airflow_health.py | 138 ++++--
.../src/airflow/api_fastapi/common/db/assets.py | 22 +-
.../airflow/api_fastapi/core_api/datamodels/job.py | 2 +
.../api_fastapi/core_api/datamodels/monitor.py | 29 ++
.../api_fastapi/core_api/openapi/_private_ui.yaml | 12 +
.../core_api/openapi/v2-rest-api-generated.yaml | 137 ++++++
.../core_api/routes/public/backfills.py | 16 +-
.../api_fastapi/core_api/routes/public/pools.py | 10 +-
.../core_api/routes/public/variables.py | 20 +-
.../src/airflow/api_fastapi/core_api/security.py | 69 ++-
.../api_fastapi/core_api/services/public/pools.py | 21 +-
.../core_api/services/public/variables.py | 28 +-
.../airflow/cli/commands/dag_processor_command.py | 2 +-
.../src/airflow/cli/commands/triggerer_command.py | 4 +-
.../src/airflow/dag_processing/collection.py | 22 +-
airflow-core/src/airflow/jobs/job.py | 8 +-
.../src/airflow/jobs/triggerer_job_runner.py | 4 +-
...e.py => 0133_3_4_0_add_scope_columns_to_job.py} | 32 +-
airflow-core/src/airflow/models/serialized_dag.py | 21 +-
airflow-core/src/airflow/models/variable.py | 12 +-
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 257 ++++++++++-
.../airflow/ui/openapi-gen/requests/types.gen.ts | 37 ++
.../airflow/ui/public/i18n/locales/ko/admin.json | 14 +-
.../airflow/ui/public/i18n/locales/ko/browse.json | 2 +
.../airflow/ui/public/i18n/locales/ko/common.json | 53 ++-
.../ui/public/i18n/locales/ko/components.json | 4 +
.../src/airflow/ui/public/i18n/locales/ko/dag.json | 2 +
.../airflow/ui/public/i18n/locales/ko/dags.json | 8 +
.../ui/public/i18n/locales/zh-TW/admin.json | 16 +-
.../ui/public/i18n/locales/zh-TW/assets.json | 12 +-
.../ui/public/i18n/locales/zh-TW/browse.json | 2 +
.../ui/public/i18n/locales/zh-TW/common.json | 24 +-
.../ui/public/i18n/locales/zh-TW/components.json | 4 +
.../airflow/ui/public/i18n/locales/zh-TW/dag.json | 2 +
.../airflow/ui/public/i18n/locales/zh-TW/dags.json | 8 +
.../airflow/utils/dag_version_inflation_checker.py | 2 -
airflow-core/src/airflow/utils/db.py | 2 +-
.../tests/unit/always/test_providers_manager.py | 4 +
airflow-core/tests/unit/always/test_secrets.py | 22 +-
.../tests/unit/api/common/test_airflow_health.py | 494 +++++++++++++++++----
.../auth/managers/test_base_auth_manager.py | 6 +-
.../core_api/routes/public/test_backfills.py | 64 ++-
.../api_fastapi/core_api/routes/public/test_job.py | 21 +
.../core_api/routes/public/test_monitor.py | 63 ++-
.../core_api/routes/public/test_pools.py | 42 ++
.../core_api/routes/public/test_task_instances.py | 2 +
.../core_api/routes/public/test_variables.py | 31 ++
.../api_fastapi/core_api/routes/ui/test_assets.py | 44 ++
.../unit/api_fastapi/core_api/test_security.py | 75 ++--
.../cli/commands/test_dag_processor_command.py | 1 +
.../unit/cli/commands/test_triggerer_command.py | 22 +-
.../tests/unit/dag_processing/test_collection.py | 100 ++++-
.../tests/unit/dag_processing/test_manager.py | 44 +-
airflow-core/tests/unit/jobs/test_triggerer_job.py | 21 +-
.../tests/unit/models/test_serialized_dag.py | 106 +++++
airflow-core/tests/unit/models/test_variable.py | 62 +++
.../utils/test_dag_version_inflation_checker.py | 45 +-
.../src/airflowctl/api/datamodels/generated.py | 74 ++-
contributing-docs/testing/integration_tests.rst | 3 +-
dev/README_RELEASE_PROVIDERS.md | 97 ++--
.../commands/release_management_commands.py | 2 +-
.../prepare_providers/provider_documentation.py | 4 +
dev/breeze/src/airflow_breeze/utils/path_utils.py | 16 +
dev/breeze/tests/test_provider_documentation.py | 38 ++
dev/breeze/tests/test_shim_version_check.py | 123 +++++
dev/breeze/uv.lock | 132 +++---
devel-common/pyproject.toml | 2 +-
docs/spelling_wordlist.txt | 1 +
providers/AGENTS.md | 8 +-
providers/airbyte/provider.yaml | 4 +-
.../airflow/providers/airbyte/get_provider_info.py | 4 +-
.../providers/alibaba/cloud/hooks/base_alibaba.py | 5 -
providers/apache/arrow/provider.yaml | 7 +
.../providers/apache/arrow/get_provider_info.py | 5 +
.../providers/apache/iceberg/triggers/iceberg.py | 4 +-
.../unit/apache/iceberg/triggers/test_iceberg.py | 21 +-
.../airflow/providers/arangodb/hooks/arangodb.py | 2 +-
providers/common/ai/docs/operators/llm_branch.rst | 14 +-
.../common/ai/docs/operators/llm_file_analysis.rst | 16 +-
providers/common/ai/docs/retry_policies.rst | 2 +-
providers/common/ai/provider.yaml | 14 +-
.../providers/common/ai/get_provider_info.py | 21 +-
.../providers/common/ai/hooks/pydantic_ai.py | 2 +-
.../providers/common/ai/operators/llm_branch.py | 22 +-
.../providers/common/ai/utils/file_analysis.py | 39 +-
.../tests/unit/common/ai/hooks/test_pydantic_ai.py | 35 +-
.../unit/common/ai/operators/test_llm_branch.py | 34 ++
.../unit/common/ai/utils/test_file_analysis.py | 83 +++-
.../src/airflow/providers/edge3/cli/worker.py | 2 +-
providers/exasol/README.rst | 2 +-
providers/exasol/docs/index.rst | 2 +-
providers/exasol/pyproject.toml | 4 +-
.../src/airflow/providers/exasol/hooks/exasol.py | 64 ++-
.../exasol/tests/unit/exasol/hooks/test_exasol.py | 25 +-
providers/git/provider.yaml | 5 +-
.../src/airflow/providers/git/get_provider_info.py | 2 +-
providers/google/README.rst | 2 +-
providers/google/docs/connections/gcp_sql.rst | 7 +-
providers/google/docs/index.rst | 2 +-
.../google/docs/operators/transfer/sftp_to_gcs.rst | 14 +
providers/google/provider.yaml | 22 +
providers/google/pyproject.toml | 2 +-
.../providers/google/cloud/hooks/cloud_composer.py | 30 +-
.../cloud/hooks/vertex_ai/batch_prediction_job.py | 10 +-
.../google/cloud/transfers/sftp_to_gcs.py | 21 +-
.../providers/google/cloud/triggers/cloud_build.py | 5 +-
.../airflow/providers/google/get_provider_info.py | 14 +
.../airflow/providers/google/suite/hooks/drive.py | 28 +-
.../providers/google/suite/operators/sheets.py | 44 +-
.../google/suite/transfers/gcs_to_gdrive.py | 3 +-
.../bigquery/example_bigquery_queries_async.py | 3 +-
.../cloud_sql/example_cloud_sql_query_proxy_iam.py | 31 +-
.../google/cloud/gcs/example_gcs_to_gdrive.py | 31 +-
.../google/cloud/gcs/example_gcs_to_sheets.py | 31 +-
.../google/cloud/gcs/example_gdrive_to_gcs.py | 40 +-
.../system/google/cloud/gcs/example_sftp_to_gcs.py | 12 +
.../system/google/cloud/gcs/example_sheets.py | 46 +-
.../google/cloud/gcs/example_sheets_to_gcs.py | 23 +-
.../gcs/resources/openlineage/sftp_to_gcs.json | 36 ++
.../cloud/sql_to_sheets/example_sql_to_sheets.py | 23 +-
.../hooks/vertex_ai/test_batch_prediction_job.py | 18 +-
.../google/cloud/transfers/test_sftp_to_gcs.py | 80 +++-
.../unit/google/cloud/triggers/test_cloud_build.py | 19 +
.../tests/unit/google/suite/hooks/test_drive.py | 23 +-
.../unit/google/suite/operators/test_sheets.py | 49 +-
.../db2/src/airflow/providers/ibm/db2/hooks/db2.py | 2 +-
providers/microsoft/azure/provider.yaml | 6 +-
.../providers/microsoft/azure/get_provider_info.py | 3 +-
.../airflow/providers/microsoft/azure/hooks/asb.py | 2 +-
providers/redis/docs/connections.rst | 46 +-
providers/redis/provider.yaml | 14 +
.../airflow/providers/redis/get_provider_info.py | 9 +
.../src/airflow/providers/redis/hooks/redis.py | 87 +++-
.../tests/integration/redis/hooks/test_redis.py | 66 +++
.../redis/tests/unit/redis/hooks/test_redis.py | 114 +++++
providers/snowflake/docs/operators/snowpark.rst | 4 +-
providers/snowflake/provider.yaml | 5 +-
.../providers/snowflake/get_provider_info.py | 3 +-
.../airflow/providers/telegram/hooks/telegram.py | 2 +-
scripts/ci/docker-compose/forward-credentials.yml | 2 +
scripts/ci/docker-compose/integration-redis.yml | 31 ++
scripts/ci/prek/check_imports_in_providers.py | 2 +-
scripts/ci/prek/ruff_format.py | 2 +-
scripts/docker/entrypoint_ci.sh | 38 +-
scripts/docker/entrypoint_exec.sh | 6 +
scripts/tools/setup_breeze | 31 +-
.../tests/secrets_backend/test_base.py | 10 +-
uv.lock | 413 +++++++++--------
157 files changed, 4088 insertions(+), 935 deletions(-)
create mode 100644 airflow-core/newsfragments/71113.significant.rst
create mode 100644 airflow-core/newsfragments/72042.bugfix.rst
copy
airflow-core/src/airflow/migrations/versions/{0116_3_3_0_add_team_name_to_trigger_table.py
=> 0133_3_4_0_add_scope_columns_to_job.py} (58%)
