This is an automated email from the ASF dual-hosted git repository.
ash pushed a change to branch remove-executor-loader-caching
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard af0a1d80efa Remove caching inside ExecutorLoader in favour of
`job.executors` property
add 03d6c2b9ec6 AIP-84: Migrate get_log endpoint (#44238)
add 8f567ec4b9a Lower-bind pydantic to 2.10.1 (#44284)
add cf2656179a8 Handle XCom value errors in FAB's XCom list view (#44275)
add 00fd540fde3 AIP-84 Migrate public endpoint Clear Task Instances to
FastAPI (#44220)
add 4f8cb6e328a AIP84: UI endpoint for config (#44265)
add 208f07b9e29 Add base model for rest api; set from_attributes=True
(#44267)
add fe166ec0391 Specify workspaceFolder so devcontainer will start with
local docker from vscode (#44273)
add 5b2a96ee72a Don't exit doc preparation even if changelog is empty for
any provider (#44207)
add d79c6c21f2d [edge] Clean up of dead tasks in edge_jobs table (#44280)
add 66407e8d226 Update backfill `list` endpoint to be async (#44208)
add fedfaa703e5 Use `JSONB` type for `XCom.value` column in PostgreSQL
(#44290)
add ab38d01c5c0 Bump Ruff to 0.8.0 (#44287)
add 91bd1eafb03 Introduce gcp advance API (V3) translate native datasets
operators (#44271)
add d6364992b8a Allow dropping `_xcom_archive` table via CLI (#44291)
add b22e3c1fcd5 Fix Dataplex Data Quality partial update (#44262)
add 5f6b233906e feat: add OpenLineage support for
BigQueryToBigQueryOperator (#44214)
add da946865205 Fix incorrect query in
`BigQueryAsyncHook.create_job_for_partition_get`. (#44225)
add 32f064f73c9 Trigger openlineage test when asset files changes (#44172)
add e5de5506d54 Fix the Show Down text (#44292)
add 3c58e01266f Bump `google-cloud-translate` to `3.16` (#44297)
add 2179b1778a3 Remove unused code from `airflow/api/common/mark_tasks.py`
(#44296)
add 00a3099b352 rename run_id to dag_run_id in DagRun response (#44305)
add 21238d1d613 Bump `termcolor` to `2.5.0` (#44295)
add d2c4c120984 fix mypy failure due to termcolor upgrade (#44313)
add b1e02120e50 use __file__ for fileloc (#44312)
add 29483384be5 Only install eval-type-backport for Python < 3.10 (#44294)
add ab72e944dba Replacee `breeze testing tests` command in a few places
remaining (#44299)
add 49c60677dbd Add copy-pasteable cherry-picker command if it fails to
cherry-pick (#44316)
add 5e52bd29abd Avoid grouping task instance stats by try_number for
dynamic mapped tasks (#44300)
add a46e9412823 Update README_AIRFLOW3_DEV.md (#44304)
add 2ed30210c9a refactor TestPostDagRun.test_should_respond_200 (#44308)
add 1275fec92fd Use Python 3.9 as target version for Ruff & Black rules
(#44298)
add f0da8eeab3e Prepare docs for Nov 2nd wave of ad hoc providers (#44321)
add 33afa8f51b6 Workaround Pydantic 2.10.0/2.10.1 for compatibility tests
(#44317)
add 18d1b97b79a Refactor package checks to be test and remove duplication
(#44318)
add 2154e89967b Support multiple executors in chart (#43606)
add 53814271df0 Remove py38 as breeze's target (#44328)
add cf6cdca2257 setup default logging in test dag serialization tests
(#44329)
add 3545cde50c2 Bugfix/caplog flaky test in extra operator link test
(#44331)
add 5a68bca9b03 Add edge provider to boring-cyborg.yml (#44338)
add 074c822c6a1 Fix 401 and 403 handling new UI (#44342)
add 05f935d2a6c utilize more information to deterministically generate
OpenLineage run_id (#43936)
add acf106b5a17 AIP-84 Add Lists Jobs with Filters API (#43859)
add b4c48062788 Add `wait_policy` option to `EmrCreateJobFlowOperator`
(#44055)
add bee7f0cdeac AIP-82 Save references between assets and triggers (#43826)
add d6887637d56 fix ruff errors in routes public job (#44363)
add db260b053fe bump uv version to 0.5.4 (#44349)
add 1351b08d86f AIP-84: Migrate Extra Links endpoint to fastapi (#44277)
add 19e97dac673 AIP-84 Get Task Instance Tries (#44301)
add 8dc5fcdc6af Use UI config (#44364)
add 2d9e7a51bb3 Independently update source code changes in DagCode
(#44189)
add 222dbdc022e Clean up the pre-commit config (#44347)
add 4404e64247d Move triggers to standard provider (#43608)
add 28ce656772c Replace var names `select`, `base_select`, `base_query`
with `statement` (#44270)
add de786e4667f Remove caching inside ExecutorLoader in favour of
`job.executors` property
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (af0a1d80efa)
\
N -- N -- N refs/heads/remove-executor-loader-caching
(de786e4667f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.devcontainer/mysql/devcontainer.json | 7 +-
.devcontainer/postgres/devcontainer.json | 7 +-
.github/boring-cyborg.yml | 9 +-
.github/workflows/ci.yml | 10 +-
...ck-providers.yml => test-provider-packages.yml} | 111 +-
.pre-commit-config.yaml | 58 +-
Dockerfile | 2 +-
Dockerfile.ci | 13 +-
airflow/api/common/mark_tasks.py | 77 +-
airflow/api_connexion/endpoints/dag_endpoint.py | 3 +-
airflow/api_connexion/endpoints/dag_parsing.py | 3 +-
.../api_connexion/endpoints/dag_run_endpoint.py | 3 +-
.../api_connexion/endpoints/dag_source_endpoint.py | 3 +-
.../api_connexion/endpoints/extra_link_endpoint.py | 2 +
.../endpoints/import_error_endpoint.py | 3 +-
airflow/api_connexion/endpoints/pool_endpoint.py | 4 +-
airflow/api_connexion/endpoints/request_dict.py | 3 +-
.../endpoints/task_instance_endpoint.py | 5 +-
airflow/api_connexion/endpoints/update_mask.py | 3 +-
airflow/api_connexion/parameters.py | 3 +-
airflow/api_connexion/types.py | 5 +-
airflow/api_fastapi/common/db/common.py | 107 +-
airflow/api_fastapi/common/headers.py | 3 +-
airflow/api_fastapi/common/parameters.py | 71 +-
airflow/api_fastapi/common/router.py | 3 +-
airflow/api_fastapi/common/types.py | 11 +-
.../datamodels/variable.py => core_api/base.py} | 14 +-
airflow/api_fastapi/core_api/datamodels/assets.py | 3 +-
.../api_fastapi/core_api/datamodels/backfills.py | 3 +-
airflow/api_fastapi/core_api/datamodels/config.py | 2 +-
.../api_fastapi/core_api/datamodels/connections.py | 3 +-
airflow/api_fastapi/core_api/datamodels/dag_run.py | 5 +-
.../api_fastapi/core_api/datamodels/dag_sources.py | 2 +-
.../api_fastapi/core_api/datamodels/dag_stats.py | 3 +-
.../api_fastapi/core_api/datamodels/dag_warning.py | 3 +-
airflow/api_fastapi/core_api/datamodels/dags.py | 28 +-
.../api_fastapi/core_api/datamodels/event_logs.py | 8 +-
.../api_fastapi/core_api/datamodels/extra_links.py | 9 +
.../core_api/datamodels/import_error.py | 8 +-
airflow/api_fastapi/core_api/datamodels/job.py | 11 +-
.../core_api/datamodels/{version.py => log.py} | 8 +-
airflow/api_fastapi/core_api/datamodels/monitor.py | 2 +-
airflow/api_fastapi/core_api/datamodels/plugins.py | 3 +-
airflow/api_fastapi/core_api/datamodels/pools.py | 6 +-
.../api_fastapi/core_api/datamodels/providers.py | 2 +-
.../core_api/datamodels/task_instances.py | 64 +-
airflow/api_fastapi/core_api/datamodels/tasks.py | 3 +-
airflow/api_fastapi/core_api/datamodels/trigger.py | 4 +-
.../datamodels/{dag_stats.py => ui/config.py} | 45 +-
airflow/api_fastapi/core_api/datamodels/ui/dags.py | 3 +-
.../core_api/datamodels/ui/dashboard.py | 2 +-
.../api_fastapi/core_api/datamodels/variables.py | 5 +-
airflow/api_fastapi/core_api/datamodels/version.py | 2 +-
airflow/api_fastapi/core_api/datamodels/xcom.py | 4 +-
.../api_fastapi/core_api/openapi/v1-generated.yaml | 692 +++++++-
.../api_fastapi/core_api/routes/public/__init__.py | 7 +
.../api_fastapi/core_api/routes/public/assets.py | 23 +-
.../core_api/routes/public/backfills.py | 27 +-
.../core_api/routes/public/connections.py | 16 +-
.../api_fastapi/core_api/routes/public/dag_run.py | 26 +-
.../core_api/routes/public/dag_stats.py | 2 +-
.../core_api/routes/public/dag_warning.py | 5 +-
airflow/api_fastapi/core_api/routes/public/dags.py | 18 +-
.../core_api/routes/public/event_logs.py | 33 +-
.../core_api/routes/public/extra_links.py} | 52 +-
.../core_api/routes/public/import_error.py | 9 +-
airflow/api_fastapi/core_api/routes/public/job.py | 128 ++
airflow/api_fastapi/core_api/routes/public/log.py | 146 ++
.../api_fastapi/core_api/routes/public/plugins.py | 7 +-
.../api_fastapi/core_api/routes/public/pools.py | 15 +-
.../core_api/routes/public/task_instances.py | 196 ++-
.../api_fastapi/core_api/routes/public/tasks.py | 7 +-
.../core_api/routes/public/variables.py | 10 +-
.../api_fastapi/core_api/routes/public/version.py | 2 +-
airflow/api_fastapi/core_api/routes/public/xcom.py | 6 +-
airflow/api_fastapi/core_api/routes/ui/__init__.py | 2 +
airflow/api_fastapi/core_api/routes/ui/config.py | 71 +
airflow/api_fastapi/core_api/routes/ui/dags.py | 6 +-
.../api_fastapi/core_api/routes/ui/dashboard.py | 2 +-
airflow/api_fastapi/core_api/security.py | 3 +-
.../execution_api/datamodels/connection.py | 4 +-
.../execution_api/datamodels/taskinstance.py | 5 +-
.../api_fastapi/execution_api/datamodels/token.py | 2 +-
.../execution_api/datamodels/variable.py | 6 +-
.../api_fastapi/execution_api/datamodels/xcom.py | 2 +-
.../execution_api/routes/connections.py | 2 +-
airflow/auth/managers/base_auth_manager.py | 3 +-
airflow/cli/cli_config.py | 3 +-
airflow/cli/cli_parser.py | 7 +-
airflow/cli/commands/cheat_sheet_command.py | 3 +-
airflow/cli/commands/standalone_command.py | 8 +-
airflow/cli/commands/task_command.py | 3 +-
airflow/cli/commands/triggerer_command.py | 2 +-
airflow/cli/simple_table.py | 3 +-
airflow/cli/utils.py | 3 +-
airflow/configuration.py | 12 +-
airflow/dag_processing/collection.py | 96 ++
airflow/dag_processing/manager.py | 3 +-
airflow/dag_processing/processor.py | 11 +-
airflow/decorators/__init__.pyi | 3 +-
airflow/decorators/base.py | 5 +-
airflow/decorators/bash.py | 3 +-
airflow/decorators/python.py | 3 +-
airflow/decorators/sensor.py | 3 +-
airflow/decorators/task_group.py | 3 +-
airflow/example_dags/example_params_ui_tutorial.py | 422 ++---
airflow/executors/base_executor.py | 11 +-
airflow/executors/executor_loader.py | 2 +-
airflow/executors/local_executor.py | 6 +-
airflow/io/__init__.py | 2 +-
airflow/io/path.py | 3 +-
airflow/io/typedef.py | 4 +-
airflow/jobs/scheduler_job_runner.py | 10 +-
airflow/metrics/otel_logger.py | 3 +-
airflow/metrics/validators.py | 4 +-
.../versions/0047_3_0_0_add_dag_versioning.py | 10 +-
airflow/models/abstractoperator.py | 3 +-
airflow/models/asset.py | 2 +-
airflow/models/baseoperator.py | 6 +-
airflow/models/dag.py | 8 +-
airflow/models/dagbag.py | 4 +
airflow/models/dagcode.py | 114 +-
airflow/models/dagrun.py | 8 +-
airflow/models/expandinput.py | 6 +-
airflow/models/mappedoperator.py | 6 +-
airflow/models/param.py | 3 +-
airflow/models/skipmixin.py | 3 +-
airflow/models/taskinstance.py | 10 +-
airflow/models/taskmap.py | 3 +-
airflow/models/trigger.py | 13 +-
airflow/models/xcom.py | 6 +-
airflow/models/xcom_arg.py | 3 +-
airflow/notifications/basenotifier.py | 3 +-
airflow/operators/branch.py | 3 +-
airflow/operators/email.py | 3 +-
airflow/operators/latest_only.py | 3 +-
airflow/plugins_manager.py | 5 +-
airflow/providers_manager.py | 3 +-
airflow/sensors/base.py | 5 +-
airflow/sensors/external_task.py | 7 +-
airflow/serialization/json_schema.py | 3 +-
airflow/serialization/pydantic/asset.py | 6 +-
airflow/serialization/pydantic/dag.py | 6 +-
airflow/serialization/pydantic/dag_run.py | 5 +-
airflow/serialization/pydantic/taskinstance.py | 3 +-
airflow/serialization/pydantic/trigger.py | 10 +-
airflow/serialization/serde.py | 11 +-
airflow/serialization/serialized_objects.py | 7 +-
airflow/settings.py | 12 +-
airflow/template/templater.py | 3 +-
airflow/ti_deps/deps/base_ti_dep.py | 3 +-
airflow/ti_deps/deps/trigger_rule_dep.py | 3 +-
airflow/timetables/base.py | 3 +-
airflow/timetables/events.py | 3 +-
airflow/timetables/simple.py | 3 +-
airflow/triggers/base.py | 11 +-
airflow/ui/openapi-gen/queries/common.ts | 475 ++++--
airflow/ui/openapi-gen/queries/prefetch.ts | 587 +++++--
airflow/ui/openapi-gen/queries/queries.ts | 1101 +++++++-----
airflow/ui/openapi-gen/queries/suspense.ts | 813 ++++++---
airflow/ui/openapi-gen/requests/schemas.gen.ts | 336 +++-
airflow/ui/openapi-gen/requests/services.gen.ts | 942 +++++++----
airflow/ui/openapi-gen/requests/types.gen.ts | 746 ++++++---
.../src/components/DataTable/useTableUrlState.ts | 4 +-
airflow/ui/src/components/TogglePause.tsx | 5 +-
.../ui/src/context/timezone/TimezoneProvider.tsx | 2 +-
airflow/ui/src/layouts/BaseLayout.tsx | 2 +-
airflow/ui/src/layouts/Nav/DocsButton.tsx | 2 +-
airflow/ui/src/main.tsx | 6 +-
airflow/ui/src/pages/DagsList/Dag/Code/Code.tsx | 2 +-
airflow/ui/src/pages/DagsList/DagsFilters.tsx | 8 +-
airflow/ui/src/pages/DagsList/DagsList.tsx | 8 +-
airflow/ui/src/pages/DagsList/RecentRuns.tsx | 2 +-
airflow/ui/src/pages/Dashboard/Health/Health.tsx | 13 +-
airflow/ui/src/queries/useConfig.tsx | 16 +-
airflow/utils/context.py | 8 +-
airflow/utils/context.pyi | 3 +-
airflow/utils/db.py | 32 +-
airflow/utils/db_cleanup.py | 16 +-
airflow/utils/email.py | 3 +-
airflow/utils/entry_points.py | 6 +-
airflow/utils/file.py | 4 +-
airflow/utils/helpers.py | 3 +-
airflow/utils/log/file_task_handler.py | 3 +-
airflow/utils/log/log_reader.py | 3 +-
airflow/utils/log/secrets_masker.py | 11 +-
airflow/utils/net.py | 4 +-
airflow/utils/operator_helpers.py | 3 +-
airflow/utils/process_utils.py | 2 +-
airflow/utils/session.py | 21 +-
airflow/utils/sqlalchemy.py | 3 +-
airflow/utils/task_group.py | 3 +-
airflow/utils/timeout.py | 4 +-
airflow/utils/weekday.py | 2 +-
airflow/www/auth.py | 3 +-
airflow/www/extensions/init_wsgi_middlewares.py | 3 +-
airflow/www/forms.py | 2 +-
airflow/www/utils.py | 20 +-
airflow/www/views.py | 20 +-
chart/templates/NOTES.txt | 6 +-
chart/templates/_helpers.yaml | 8 +-
chart/templates/check-values.yaml | 2 +-
chart/templates/configmaps/configmap.yaml | 2 +-
chart/templates/flower/flower-deployment.yaml | 2 +-
chart/templates/flower/flower-ingress.yaml | 2 +-
chart/templates/flower/flower-service.yaml | 2 +-
chart/templates/flower/flower-serviceaccount.yaml | 2 +-
.../security-context-constraint-rolebinding.yaml | 2 +-
chart/templates/redis/redis-networkpolicy.yaml | 2 +-
chart/templates/redis/redis-service.yaml | 2 +-
chart/templates/redis/redis-serviceaccount.yaml | 2 +-
chart/templates/redis/redis-statefulset.yaml | 2 +-
.../scheduler/scheduler-networkpolicy.yaml | 2 +-
chart/templates/scheduler/scheduler-service.yaml | 2 +-
.../secrets/result-backend-connection-secret.yaml | 2 +-
chart/templates/workers/worker-deployment.yaml | 2 +-
chart/templates/workers/worker-kedaautoscaler.yaml | 2 +-
chart/templates/workers/worker-networkpolicy.yaml | 2 +-
chart/templates/workers/worker-service.yaml | 2 +-
chart/templates/workers/worker-serviceaccount.yaml | 2 +-
chart/values.schema.json | 12 +-
chart/values.yaml | 4 +-
contributing-docs/05_pull_requests.rst | 3 +-
dev/README_AIRFLOW3_DEV.md | 63 +-
dev/backport/update_backport_status.py | 18 +-
dev/breeze/README.md | 2 +-
dev/breeze/doc/03_developer_tasks.rst | 2 +-
dev/breeze/doc/05_test_commands.rst | 8 +-
dev/breeze/doc/ci/02_images.md | 2 +-
dev/breeze/doc/ci/04_selective_checks.md | 2 +-
dev/breeze/pyproject.toml | 2 +-
.../commands/release_management_commands.py | 6 +-
dev/breeze/src/airflow_breeze/global_constants.py | 4 +-
dev/breeze/src/airflow_breeze/utils/console.py | 2 +-
.../src/airflow_breeze/utils/selective_checks.py | 32 +-
.../tests/test_pytest_args_for_test_types.py | 1 -
dev/breeze/tests/test_selective_checks.py | 38 +-
.../test_examples_of_prod_image_building.py | 4 +-
.../operators/emr/emr.rst | 9 +
docs/apache-airflow-providers-celery/commits.rst | 15 +-
docs/apache-airflow-providers-celery/index.rst | 6 +-
.../commits.rst | 15 +
.../index.rst | 2 +-
docs/apache-airflow-providers-google/commits.rst | 23 +
docs/apache-airflow-providers-google/index.rst | 10 +-
.../operators/cloud/translate.rst | 85 +
docs/apache-airflow-providers-standard/commits.rst | 17 +
docs/apache-airflow-providers-standard/index.rst | 2 +-
.../authoring-and-scheduling/deferring.rst | 12 +-
docs/apache-airflow/img/airflow_erd.sha256 | 2 +-
docs/apache-airflow/img/airflow_erd.svg | 1769 ++++++++++----------
docs/build_docs.py | 3 +-
docs/exts/docs_build/fetch_inventories.py | 2 +-
docs/exts/docs_build/lint_checks.py | 2 +-
docs/exts/operators_and_hooks_ref.py | 7 +-
docs/exts/providers_extensions.py | 3 +-
docs/exts/sphinx_script_update.py | 4 +-
docs/spelling_wordlist.txt | 1 +
generated/provider_dependencies.json | 5 +-
hatch_build.py | 12 +-
helm_tests/airflow_aux/test_basic_helm_chart.py | 10 +-
helm_tests/other/test_keda.py | 4 +-
newsfragments/44300.bugfix.rst | 1 +
newsfragments/aip-72.significant.rst | 6 +-
.../performance_dag/performance_dag_utils.py | 4 +-
providers/pyproject.toml | 2 +-
.../airflow/providers/airbyte/operators/airbyte.py | 3 +-
.../airflow/providers/airbyte/sensors/airbyte.py | 3 +-
.../airflow/providers/airbyte/triggers/airbyte.py | 3 +-
.../alibaba/cloud/hooks/analyticdb_spark.py | 3 +-
.../alibaba/cloud/operators/analyticdb_spark.py | 3 +-
.../alibaba/cloud/sensors/analyticdb_spark.py | 3 +-
.../providers/alibaba/cloud/sensors/oss_key.py | 3 +-
.../amazon/aws/auth_manager/avp/facade.py | 3 +-
.../amazon/aws/auth_manager/aws_auth_manager.py | 3 +-
.../amazon/aws/executors/batch/batch_executor.py | 7 +-
.../providers/amazon/aws/executors/batch/utils.py | 6 +-
.../amazon/aws/executors/ecs/ecs_executor.py | 3 +-
.../providers/amazon/aws/executors/ecs/utils.py | 6 +-
.../src/airflow/providers/amazon/aws/fs/s3.py | 4 +-
.../airflow/providers/amazon/aws/hooks/appflow.py | 3 +-
.../airflow/providers/amazon/aws/hooks/athena.py | 3 +-
.../airflow/providers/amazon/aws/hooks/dynamodb.py | 3 +-
.../src/airflow/providers/amazon/aws/hooks/eks.py | 3 +-
.../airflow/providers/amazon/aws/hooks/kinesis.py | 2 +-
.../src/airflow/providers/amazon/aws/hooks/logs.py | 3 +-
.../providers/amazon/aws/hooks/redshift_cluster.py | 3 +-
.../providers/amazon/aws/hooks/redshift_data.py | 3 +-
.../src/airflow/providers/amazon/aws/hooks/s3.py | 3 +-
.../providers/amazon/aws/hooks/sagemaker.py | 3 +-
.../src/airflow/providers/amazon/aws/hooks/ses.py | 3 +-
.../providers/amazon/aws/notifications/sns.py | 2 +-
.../providers/amazon/aws/notifications/sqs.py | 2 +-
.../providers/amazon/aws/operators/athena.py | 3 +-
.../providers/amazon/aws/operators/base_aws.py | 2 +-
.../providers/amazon/aws/operators/batch.py | 3 +-
.../providers/amazon/aws/operators/bedrock.py | 3 +-
.../amazon/aws/operators/cloud_formation.py | 3 +-
.../providers/amazon/aws/operators/comprehend.py | 3 +-
.../providers/amazon/aws/operators/datasync.py | 3 +-
.../airflow/providers/amazon/aws/operators/dms.py | 3 +-
.../airflow/providers/amazon/aws/operators/ec2.py | 3 +-
.../airflow/providers/amazon/aws/operators/ecs.py | 3 +-
.../airflow/providers/amazon/aws/operators/eks.py | 7 +-
.../airflow/providers/amazon/aws/operators/emr.py | 39 +-
.../providers/amazon/aws/operators/eventbridge.py | 3 +-
.../providers/amazon/aws/operators/glacier.py | 3 +-
.../airflow/providers/amazon/aws/operators/glue.py | 3 +-
.../providers/amazon/aws/operators/glue_crawler.py | 3 +-
.../amazon/aws/operators/glue_databrew.py | 3 +-
.../amazon/aws/operators/kinesis_analytics.py | 3 +-
.../amazon/aws/operators/lambda_function.py | 3 +-
.../providers/amazon/aws/operators/neptune.py | 3 +-
.../providers/amazon/aws/operators/quicksight.py | 3 +-
.../airflow/providers/amazon/aws/operators/rds.py | 3 +-
.../amazon/aws/operators/redshift_cluster.py | 3 +-
.../airflow/providers/amazon/aws/operators/s3.py | 3 +-
.../providers/amazon/aws/operators/sagemaker.py | 3 +-
.../airflow/providers/amazon/aws/operators/sns.py | 3 +-
.../airflow/providers/amazon/aws/operators/sqs.py | 3 +-
.../amazon/aws/operators/step_function.py | 3 +-
.../airflow/providers/amazon/aws/sensors/athena.py | 3 +-
.../providers/amazon/aws/sensors/base_aws.py | 2 +-
.../airflow/providers/amazon/aws/sensors/batch.py | 3 +-
.../providers/amazon/aws/sensors/bedrock.py | 3 +-
.../amazon/aws/sensors/cloud_formation.py | 3 +-
.../providers/amazon/aws/sensors/comprehend.py | 3 +-
.../airflow/providers/amazon/aws/sensors/dms.py | 3 +-
.../providers/amazon/aws/sensors/dynamodb.py | 3 +-
.../airflow/providers/amazon/aws/sensors/ec2.py | 3 +-
.../airflow/providers/amazon/aws/sensors/ecs.py | 3 +-
.../airflow/providers/amazon/aws/sensors/eks.py | 3 +-
.../airflow/providers/amazon/aws/sensors/emr.py | 3 +-
.../providers/amazon/aws/sensors/glacier.py | 3 +-
.../airflow/providers/amazon/aws/sensors/glue.py | 3 +-
.../amazon/aws/sensors/glue_catalog_partition.py | 3 +-
.../providers/amazon/aws/sensors/glue_crawler.py | 3 +-
.../amazon/aws/sensors/kinesis_analytics.py | 3 +-
.../amazon/aws/sensors/lambda_function.py | 3 +-
.../amazon/aws/sensors/opensearch_serverless.py | 3 +-
.../providers/amazon/aws/sensors/quicksight.py | 3 +-
.../airflow/providers/amazon/aws/sensors/rds.py | 3 +-
.../amazon/aws/sensors/redshift_cluster.py | 3 +-
.../src/airflow/providers/amazon/aws/sensors/s3.py | 3 +-
.../providers/amazon/aws/sensors/sagemaker.py | 3 +-
.../airflow/providers/amazon/aws/sensors/sqs.py | 3 +-
.../providers/amazon/aws/sensors/step_function.py | 3 +-
.../amazon/aws/transfers/azure_blob_to_s3.py | 3 +-
.../airflow/providers/amazon/aws/transfers/base.py | 2 +-
.../amazon/aws/transfers/dynamodb_to_s3.py | 3 +-
.../providers/amazon/aws/transfers/exasol_to_s3.py | 3 +-
.../providers/amazon/aws/transfers/ftp_to_s3.py | 3 +-
.../providers/amazon/aws/transfers/gcs_to_s3.py | 3 +-
.../amazon/aws/transfers/glacier_to_gcs.py | 3 +-
.../amazon/aws/transfers/google_api_to_s3.py | 3 +-
.../amazon/aws/transfers/hive_to_dynamodb.py | 3 +-
.../amazon/aws/transfers/imap_attachment_to_s3.py | 3 +-
.../providers/amazon/aws/transfers/local_to_s3.py | 3 +-
.../providers/amazon/aws/transfers/mongo_to_s3.py | 3 +-
.../amazon/aws/transfers/redshift_to_s3.py | 3 +-
.../amazon/aws/transfers/s3_to_dynamodb.py | 3 +-
.../providers/amazon/aws/transfers/s3_to_ftp.py | 3 +-
.../amazon/aws/transfers/s3_to_redshift.py | 3 +-
.../providers/amazon/aws/transfers/s3_to_sftp.py | 3 +-
.../providers/amazon/aws/transfers/s3_to_sql.py | 3 +-
.../amazon/aws/transfers/salesforce_to_s3.py | 3 +-
.../providers/amazon/aws/transfers/sftp_to_s3.py | 3 +-
.../providers/amazon/aws/transfers/sql_to_s3.py | 3 +-
.../airflow/providers/amazon/aws/triggers/base.py | 3 +-
.../airflow/providers/amazon/aws/triggers/glue.py | 3 +-
.../amazon/aws/triggers/redshift_cluster.py | 3 +-
.../providers/amazon/aws/triggers/redshift_data.py | 3 +-
.../airflow/providers/amazon/aws/triggers/s3.py | 3 +-
.../providers/amazon/aws/triggers/sagemaker.py | 3 +-
.../airflow/providers/amazon/aws/triggers/sqs.py | 3 +-
.../providers/amazon/aws/utils/task_log_fetcher.py | 3 +-
.../airflow/providers/amazon/aws/utils/waiter.py | 20 +
.../providers/apache/beam/operators/beam.py | 3 +-
.../airflow/providers/apache/beam/triggers/beam.py | 3 +-
.../providers/apache/cassandra/sensors/record.py | 3 +-
.../providers/apache/cassandra/sensors/table.py | 3 +-
.../airflow/providers/apache/drill/hooks/drill.py | 3 +-
.../providers/apache/drill/operators/drill.py | 3 +-
.../airflow/providers/apache/druid/hooks/druid.py | 3 +-
.../providers/apache/druid/operators/druid.py | 3 +-
.../apache/druid/transfers/hive_to_druid.py | 3 +-
.../apache/flink/operators/flink_kubernetes.py | 3 +-
.../apache/flink/sensors/flink_kubernetes.py | 3 +-
.../providers/apache/hdfs/sensors/web_hdfs.py | 3 +-
.../providers/apache/hive/operators/hive.py | 3 +-
.../providers/apache/hive/operators/hive_stats.py | 3 +-
.../apache/hive/sensors/hive_partition.py | 3 +-
.../apache/hive/sensors/metastore_partition.py | 3 +-
.../apache/hive/sensors/named_hive_partition.py | 3 +-
.../apache/hive/transfers/hive_to_mysql.py | 3 +-
.../apache/hive/transfers/hive_to_samba.py | 3 +-
.../apache/hive/transfers/mssql_to_hive.py | 3 +-
.../apache/hive/transfers/mysql_to_hive.py | 3 +-
.../providers/apache/hive/transfers/s3_to_hive.py | 7 +-
.../apache/hive/transfers/vertica_to_hive.py | 3 +-
.../airflow/providers/apache/kafka/hooks/client.py | 3 +-
.../providers/apache/kafka/hooks/consume.py | 2 +-
.../providers/apache/kafka/operators/consume.py | 3 +-
.../providers/apache/kafka/operators/produce.py | 3 +-
.../providers/apache/kafka/sensors/kafka.py | 3 +-
.../apache/kafka/triggers/await_message.py | 3 +-
.../providers/apache/kylin/operators/kylin_cube.py | 3 +-
.../airflow/providers/apache/livy/hooks/livy.py | 3 +-
.../providers/apache/livy/operators/livy.py | 3 +-
.../airflow/providers/apache/livy/sensors/livy.py | 3 +-
.../airflow/providers/apache/livy/triggers/livy.py | 3 +-
.../airflow/providers/apache/pig/operators/pig.py | 3 +-
.../airflow/providers/apache/pinot/hooks/pinot.py | 3 +-
.../providers/apache/spark/decorators/pyspark.py | 3 +-
.../providers/apache/spark/hooks/spark_submit.py | 3 +-
.../providers/apache/spark/operators/spark_sql.py | 3 +-
.../apache/spark/operators/spark_submit.py | 3 +-
.../src/airflow/providers/apprise/hooks/apprise.py | 3 +-
.../providers/apprise/notifications/apprise.py | 2 +-
.../providers/arangodb/operators/arangodb.py | 3 +-
.../airflow/providers/arangodb/sensors/arangodb.py | 3 +-
.../providers/atlassian/jira/operators/jira.py | 3 +-
.../providers/atlassian/jira/sensors/jira.py | 3 +-
.../src/airflow/providers/celery/CHANGELOG.rst | 13 +
providers/src/airflow/providers/celery/__init__.py | 2 +-
.../providers/celery/executors/celery_executor.py | 5 +-
.../celery/executors/celery_executor_utils.py | 5 +-
.../celery/executors/celery_kubernetes_executor.py | 3 +-
.../src/airflow/providers/celery/provider.yaml | 3 +-
.../providers/cncf/kubernetes/CHANGELOG.rst | 19 +
.../airflow/providers/cncf/kubernetes/__init__.py | 2 +-
.../cncf/kubernetes/decorators/kubernetes.py | 3 +-
.../kubernetes/executors/kubernetes_executor.py | 3 +-
.../executors/kubernetes_executor_types.py | 8 +-
.../executors/local_kubernetes_executor.py | 3 +-
.../providers/cncf/kubernetes/hooks/kubernetes.py | 3 +-
.../providers/cncf/kubernetes/operators/job.py | 3 +-
.../providers/cncf/kubernetes/operators/pod.py | 4 +-
.../cncf/kubernetes/operators/resource.py | 3 +-
.../providers/cncf/kubernetes/provider.yaml | 3 +-
.../cncf/kubernetes/sensors/spark_kubernetes.py | 3 +-
.../providers/cncf/kubernetes/triggers/job.py | 3 +-
.../providers/cncf/kubernetes/triggers/pod.py | 3 +-
.../cncf/kubernetes/utils/k8s_resource_iterator.py | 3 +-
.../providers/cncf/kubernetes/utils/pod_manager.py | 4 +-
.../providers/cohere/operators/embedding.py | 3 +-
.../providers/common/compat/standard/triggers.py | 17 +-
.../providers/common/io/operators/file_transfer.py | 3 +-
.../airflow/providers/common/sql/hooks/handlers.py | 2 +-
.../src/airflow/providers/common/sql/hooks/sql.py | 8 +-
.../airflow/providers/common/sql/operators/sql.py | 3 +-
.../airflow/providers/common/sql/sensors/sql.py | 3 +-
.../providers/databricks/hooks/databricks_sql.py | 7 +-
.../providers/databricks/operators/databricks.py | 3 +-
.../databricks/operators/databricks_repos.py | 3 +-
.../databricks/operators/databricks_sql.py | 3 +-
.../databricks/sensors/databricks_partition.py | 3 +-
.../providers/databricks/sensors/databricks_sql.py | 3 +-
.../airflow/providers/dbt/cloud/triggers/dbt.py | 3 +-
.../providers/dbt/cloud/utils/openlineage.py | 1 +
.../providers/dingding/operators/dingding.py | 3 +-
.../providers/discord/operators/discord_webhook.py | 3 +-
.../airflow/providers/docker/decorators/docker.py | 3 +-
.../airflow/providers/docker/operators/docker.py | 4 +-
providers/src/airflow/providers/edge/CHANGELOG.rst | 8 +
providers/src/airflow/providers/edge/__init__.py | 2 +-
.../src/airflow/providers/edge/cli/edge_command.py | 2 +-
.../providers/edge/executors/edge_executor.py | 44 +-
.../src/airflow/providers/edge/models/edge_job.py | 4 +-
.../airflow/providers/edge/models/edge_worker.py | 8 +-
providers/src/airflow/providers/edge/provider.yaml | 4 +-
.../providers/edge/worker_api/datamodels.py | 4 +-
.../providers/elasticsearch/log/es_response.py | 2 +-
.../providers/elasticsearch/log/es_task_handler.py | 4 +-
.../src/airflow/providers/exasol/hooks/exasol.py | 3 +-
.../airflow/providers/exasol/operators/exasol.py | 3 +-
.../fab/auth_manager/cli_commands/utils.py | 7 +-
.../providers/fab/auth_manager/decorators/auth.py | 3 +-
.../providers/fab/auth_manager/fab_auth_manager.py | 3 +-
.../fab/auth_manager/security_manager/override.py | 3 +-
.../src/airflow/providers/ftp/operators/ftp.py | 3 +-
providers/src/airflow/providers/ftp/sensors/ftp.py | 3 +-
.../src/airflow/providers/google/CHANGELOG.rst | 30 +
providers/src/airflow/providers/google/__init__.py | 2 +-
.../airflow/providers/google/ads/operators/ads.py | 3 +-
.../providers/google/ads/transfers/ads_to_gcs.py | 3 +-
.../airflow/providers/google/cloud/hooks/automl.py | 3 +-
.../providers/google/cloud/hooks/bigquery.py | 5 +-
.../providers/google/cloud/hooks/bigquery_dts.py | 3 +-
.../providers/google/cloud/hooks/bigtable.py | 3 +-
.../providers/google/cloud/hooks/cloud_batch.py | 3 +-
.../providers/google/cloud/hooks/cloud_build.py | 3 +-
.../providers/google/cloud/hooks/cloud_composer.py | 3 +-
.../google/cloud/hooks/cloud_memorystore.py | 3 +-
.../providers/google/cloud/hooks/cloud_run.py | 3 +-
.../providers/google/cloud/hooks/cloud_sql.py | 3 +-
.../cloud/hooks/cloud_storage_transfer_service.py | 3 +-
.../providers/google/cloud/hooks/compute.py | 3 +-
.../providers/google/cloud/hooks/datacatalog.py | 3 +-
.../providers/google/cloud/hooks/dataflow.py | 3 +-
.../providers/google/cloud/hooks/dataform.py | 3 +-
.../providers/google/cloud/hooks/datafusion.py | 5 +-
.../providers/google/cloud/hooks/dataplex.py | 3 +-
.../providers/google/cloud/hooks/dataproc.py | 4 +-
.../google/cloud/hooks/dataproc_metastore.py | 3 +-
.../providers/google/cloud/hooks/datastore.py | 3 +-
.../airflow/providers/google/cloud/hooks/dlp.py | 3 +-
.../providers/google/cloud/hooks/functions.py | 2 +-
.../airflow/providers/google/cloud/hooks/gcs.py | 3 +-
.../airflow/providers/google/cloud/hooks/kms.py | 3 +-
.../google/cloud/hooks/kubernetes_engine.py | 3 +-
.../providers/google/cloud/hooks/life_sciences.py | 2 +-
.../google/cloud/hooks/natural_language.py | 3 +-
.../providers/google/cloud/hooks/os_login.py | 3 +-
.../airflow/providers/google/cloud/hooks/pubsub.py | 3 +-
.../providers/google/cloud/hooks/secret_manager.py | 3 +-
.../providers/google/cloud/hooks/spanner.py | 3 +-
.../providers/google/cloud/hooks/speech_to_text.py | 3 +-
.../providers/google/cloud/hooks/stackdriver.py | 3 +-
.../airflow/providers/google/cloud/hooks/tasks.py | 3 +-
.../providers/google/cloud/hooks/text_to_speech.py | 3 +-
.../providers/google/cloud/hooks/translate.py | 244 ++-
.../google/cloud/hooks/vertex_ai/auto_ml.py | 3 +-
.../cloud/hooks/vertex_ai/batch_prediction_job.py | 3 +-
.../google/cloud/hooks/vertex_ai/custom_job.py | 3 +-
.../google/cloud/hooks/vertex_ai/dataset.py | 3 +-
.../cloud/hooks/vertex_ai/endpoint_service.py | 3 +-
.../hooks/vertex_ai/hyperparameter_tuning_job.py | 3 +-
.../google/cloud/hooks/vertex_ai/model_service.py | 3 +-
.../google/cloud/hooks/vertex_ai/pipeline_job.py | 3 +-
.../cloud/hooks/vertex_ai/prediction_service.py | 3 +-
.../google/cloud/hooks/video_intelligence.py | 3 +-
.../airflow/providers/google/cloud/hooks/vision.py | 3 +-
.../providers/google/cloud/hooks/workflows.py | 3 +-
.../providers/google/cloud/links/translate.py | 56 +
.../providers/google/cloud/log/gcs_task_handler.py | 3 +-
.../google/cloud/log/stackdriver_task_handler.py | 3 +-
.../providers/google/cloud/openlineage/utils.py | 75 +-
.../providers/google/cloud/operators/automl.py | 5 +-
.../providers/google/cloud/operators/bigquery.py | 3 +-
.../google/cloud/operators/bigquery_dts.py | 3 +-
.../providers/google/cloud/operators/bigtable.py | 3 +-
.../google/cloud/operators/cloud_batch.py | 3 +-
.../google/cloud/operators/cloud_build.py | 3 +-
.../google/cloud/operators/cloud_composer.py | 3 +-
.../google/cloud/operators/cloud_memorystore.py | 3 +-
.../providers/google/cloud/operators/cloud_run.py | 3 +-
.../providers/google/cloud/operators/cloud_sql.py | 3 +-
.../operators/cloud_storage_transfer_service.py | 3 +-
.../providers/google/cloud/operators/compute.py | 3 +-
.../google/cloud/operators/datacatalog.py | 3 +-
.../providers/google/cloud/operators/dataflow.py | 3 +-
.../providers/google/cloud/operators/dataform.py | 3 +-
.../providers/google/cloud/operators/datafusion.py | 3 +-
.../providers/google/cloud/operators/dataplex.py | 68 +-
.../providers/google/cloud/operators/dataprep.py | 3 +-
.../providers/google/cloud/operators/dataproc.py | 4 +-
.../google/cloud/operators/dataproc_metastore.py | 3 +-
.../providers/google/cloud/operators/datastore.py | 3 +-
.../providers/google/cloud/operators/dlp.py | 3 +-
.../providers/google/cloud/operators/functions.py | 3 +-
.../providers/google/cloud/operators/gcs.py | 3 +-
.../google/cloud/operators/kubernetes_engine.py | 3 +-
.../google/cloud/operators/life_sciences.py | 3 +-
.../providers/google/cloud/operators/mlengine.py | 3 +-
.../google/cloud/operators/natural_language.py | 5 +-
.../providers/google/cloud/operators/pubsub.py | 3 +-
.../providers/google/cloud/operators/spanner.py | 3 +-
.../google/cloud/operators/speech_to_text.py | 3 +-
.../google/cloud/operators/stackdriver.py | 3 +-
.../providers/google/cloud/operators/tasks.py | 5 +-
.../google/cloud/operators/text_to_speech.py | 3 +-
.../providers/google/cloud/operators/translate.py | 347 +++-
.../google/cloud/operators/translate_speech.py | 3 +-
.../google/cloud/operators/vertex_ai/auto_ml.py | 3 +-
.../operators/vertex_ai/batch_prediction_job.py | 3 +-
.../google/cloud/operators/vertex_ai/custom_job.py | 3 +-
.../google/cloud/operators/vertex_ai/dataset.py | 3 +-
.../cloud/operators/vertex_ai/endpoint_service.py | 3 +-
.../cloud/operators/vertex_ai/generative_model.py | 3 +-
.../vertex_ai/hyperparameter_tuning_job.py | 3 +-
.../cloud/operators/vertex_ai/model_service.py | 3 +-
.../cloud/operators/vertex_ai/pipeline_job.py | 3 +-
.../google/cloud/operators/video_intelligence.py | 3 +-
.../providers/google/cloud/operators/vision.py | 5 +-
.../providers/google/cloud/operators/workflows.py | 3 +-
.../google/cloud/secrets/secret_manager.py | 2 +-
.../providers/google/cloud/sensors/bigquery.py | 3 +-
.../providers/google/cloud/sensors/bigquery_dts.py | 3 +-
.../providers/google/cloud/sensors/bigtable.py | 3 +-
.../google/cloud/sensors/cloud_composer.py | 3 +-
.../sensors/cloud_storage_transfer_service.py | 3 +-
.../providers/google/cloud/sensors/dataflow.py | 3 +-
.../providers/google/cloud/sensors/dataform.py | 3 +-
.../providers/google/cloud/sensors/datafusion.py | 3 +-
.../providers/google/cloud/sensors/dataplex.py | 3 +-
.../providers/google/cloud/sensors/dataprep.py | 3 +-
.../providers/google/cloud/sensors/dataproc.py | 3 +-
.../google/cloud/sensors/dataproc_metastore.py | 3 +-
.../airflow/providers/google/cloud/sensors/gcs.py | 3 +-
.../providers/google/cloud/sensors/pubsub.py | 3 +-
.../providers/google/cloud/sensors/tasks.py | 3 +-
.../providers/google/cloud/sensors/workflows.py | 3 +-
.../google/cloud/transfers/adls_to_gcs.py | 3 +-
.../google/cloud/transfers/azure_blob_to_gcs.py | 3 +-
.../cloud/transfers/azure_fileshare_to_gcs.py | 3 +-
.../google/cloud/transfers/bigquery_to_bigquery.py | 93 +-
.../google/cloud/transfers/bigquery_to_gcs.py | 16 +-
.../google/cloud/transfers/bigquery_to_mssql.py | 3 +-
.../google/cloud/transfers/bigquery_to_mysql.py | 2 +-
.../google/cloud/transfers/bigquery_to_sql.py | 3 +-
.../google/cloud/transfers/calendar_to_gcs.py | 3 +-
.../google/cloud/transfers/cassandra_to_gcs.py | 3 +-
.../google/cloud/transfers/facebook_ads_to_gcs.py | 3 +-
.../google/cloud/transfers/gcs_to_bigquery.py | 22 +-
.../providers/google/cloud/transfers/gcs_to_gcs.py | 3 +-
.../google/cloud/transfers/gcs_to_local.py | 3 +-
.../google/cloud/transfers/gcs_to_sftp.py | 3 +-
.../google/cloud/transfers/gdrive_to_gcs.py | 3 +-
.../google/cloud/transfers/gdrive_to_local.py | 3 +-
.../google/cloud/transfers/local_to_gcs.py | 3 +-
.../google/cloud/transfers/mssql_to_gcs.py | 2 +-
.../providers/google/cloud/transfers/s3_to_gcs.py | 3 +-
.../google/cloud/transfers/salesforce_to_gcs.py | 3 +-
.../google/cloud/transfers/sftp_to_gcs.py | 3 +-
.../google/cloud/transfers/sheets_to_gcs.py | 3 +-
.../providers/google/cloud/transfers/sql_to_gcs.py | 3 +-
.../providers/google/cloud/triggers/bigquery.py | 3 +-
.../google/cloud/triggers/bigquery_dts.py | 3 +-
.../providers/google/cloud/triggers/cloud_batch.py | 3 +-
.../providers/google/cloud/triggers/cloud_build.py | 3 +-
.../google/cloud/triggers/cloud_composer.py | 3 +-
.../providers/google/cloud/triggers/cloud_run.py | 3 +-
.../providers/google/cloud/triggers/cloud_sql.py | 2 +-
.../triggers/cloud_storage_transfer_service.py | 3 +-
.../providers/google/cloud/triggers/dataflow.py | 3 +-
.../providers/google/cloud/triggers/datafusion.py | 3 +-
.../providers/google/cloud/triggers/dataplex.py | 2 +-
.../providers/google/cloud/triggers/dataproc.py | 3 +-
.../airflow/providers/google/cloud/triggers/gcs.py | 3 +-
.../google/cloud/triggers/kubernetes_engine.py | 3 +-
.../providers/google/cloud/triggers/mlengine.py | 3 +-
.../providers/google/cloud/triggers/pubsub.py | 3 +-
.../providers/google/cloud/triggers/vertex_ai.py | 3 +-
.../google/cloud/utils/credentials_provider.py | 2 +-
.../providers/google/cloud/utils/dataform.py | 2 +-
.../google/cloud/utils/field_validator.py | 3 +-
.../google/cloud/utils/mlengine_operator_utils.py | 3 +-
.../providers/google/common/hooks/base_google.py | 3 +-
.../providers/google/common/hooks/discovery_api.py | 2 +-
.../providers/google/firebase/hooks/firestore.py | 2 +-
.../google/firebase/operators/firestore.py | 3 +-
.../marketing_platform/hooks/analytics_admin.py | 3 +-
.../marketing_platform/hooks/campaign_manager.py | 3 +-
.../marketing_platform/hooks/display_video.py | 3 +-
.../google/marketing_platform/hooks/search_ads.py | 3 +-
.../operators/analytics_admin.py | 3 +-
.../operators/campaign_manager.py | 3 +-
.../marketing_platform/operators/display_video.py | 3 +-
.../marketing_platform/operators/search_ads.py | 3 +-
.../marketing_platform/sensors/campaign_manager.py | 3 +-
.../marketing_platform/sensors/display_video.py | 3 +-
.../src/airflow/providers/google/provider.yaml | 7 +-
.../providers/google/suite/hooks/calendar.py | 3 +-
.../airflow/providers/google/suite/hooks/drive.py | 3 +-
.../airflow/providers/google/suite/hooks/sheets.py | 3 +-
.../providers/google/suite/operators/sheets.py | 3 +-
.../providers/google/suite/sensors/drive.py | 3 +-
.../google/suite/transfers/gcs_to_gdrive.py | 3 +-
.../google/suite/transfers/gcs_to_sheets.py | 3 +-
.../google/suite/transfers/local_to_drive.py | 3 +-
.../google/suite/transfers/sql_to_sheets.py | 3 +-
providers/src/airflow/providers/grpc/hooks/grpc.py | 3 +-
.../src/airflow/providers/grpc/operators/grpc.py | 3 +-
.../src/airflow/providers/http/operators/http.py | 3 +-
.../src/airflow/providers/http/sensors/http.py | 3 +-
.../src/airflow/providers/http/triggers/http.py | 3 +-
providers/src/airflow/providers/imap/hooks/imap.py | 3 +-
.../providers/imap/sensors/imap_attachment.py | 3 +-
.../providers/influxdb/operators/influxdb.py | 3 +-
.../src/airflow/providers/jdbc/operators/jdbc.py | 3 +-
.../jenkins/operators/jenkins_job_trigger.py | 3 +-
.../airflow/providers/jenkins/sensors/jenkins.py | 3 +-
.../providers/microsoft/azure/hooks/cosmos.py | 4 +-
.../providers/microsoft/azure/operators/adls.py | 3 +-
.../providers/microsoft/azure/operators/adx.py | 3 +-
.../providers/microsoft/azure/operators/asb.py | 3 +-
.../providers/microsoft/azure/operators/batch.py | 3 +-
.../azure/operators/container_instances.py | 3 +-
.../providers/microsoft/azure/operators/cosmos.py | 3 +-
.../microsoft/azure/operators/data_factory.py | 3 +-
.../providers/microsoft/azure/operators/msgraph.py | 2 +-
.../providers/microsoft/azure/operators/powerbi.py | 3 +-
.../providers/microsoft/azure/operators/synapse.py | 3 +-
.../microsoft/azure/operators/wasb_delete_blob.py | 3 +-
.../providers/microsoft/azure/sensors/cosmos.py | 3 +-
.../microsoft/azure/sensors/data_factory.py | 3 +-
.../providers/microsoft/azure/sensors/msgraph.py | 5 +-
.../providers/microsoft/azure/sensors/wasb.py | 3 +-
.../microsoft/azure/transfers/local_to_adls.py | 3 +-
.../microsoft/azure/transfers/local_to_wasb.py | 3 +-
.../azure/transfers/oracle_to_azure_data_lake.py | 3 +-
.../microsoft/azure/transfers/s3_to_wasb.py | 3 +-
.../microsoft/azure/transfers/sftp_to_wasb.py | 3 +-
.../microsoft/azure/triggers/data_factory.py | 3 +-
.../providers/microsoft/azure/triggers/msgraph.py | 3 +-
.../providers/microsoft/azure/triggers/powerbi.py | 3 +-
.../providers/microsoft/azure/triggers/wasb.py | 3 +-
.../providers/microsoft/mssql/operators/mssql.py | 3 +-
.../airflow/providers/microsoft/psrp/hooks/psrp.py | 3 +-
.../providers/microsoft/winrm/operators/winrm.py | 3 +-
.../src/airflow/providers/mongo/hooks/mongo.py | 3 +-
.../src/airflow/providers/mongo/sensors/mongo.py | 3 +-
.../src/airflow/providers/mysql/operators/mysql.py | 3 +-
.../providers/mysql/transfers/presto_to_mysql.py | 3 +-
.../providers/mysql/transfers/s3_to_mysql.py | 3 +-
.../providers/mysql/transfers/trino_to_mysql.py | 3 +-
.../providers/mysql/transfers/vertica_to_mysql.py | 3 +-
.../src/airflow/providers/neo4j/operators/neo4j.py | 3 +-
providers/src/airflow/providers/odbc/hooks/odbc.py | 5 +-
.../airflow/providers/openai/operators/openai.py | 3 +-
.../airflow/providers/openai/triggers/openai.py | 3 +-
.../providers/openlineage/extractors/manager.py | 3 +-
.../providers/openlineage/plugins/adapter.py | 3 +-
.../providers/openlineage/plugins/listener.py | 11 +
.../providers/openlineage/plugins/macros.py | 1 +
.../src/airflow/providers/openlineage/utils/sql.py | 4 +-
.../airflow/providers/openlineage/utils/utils.py | 37 +-
.../providers/opensearch/log/os_response.py | 2 +-
.../providers/opensearch/log/os_task_handler.py | 4 +-
.../providers/opensearch/operators/opensearch.py | 3 +-
.../providers/opsgenie/notifications/opsgenie.py | 3 +-
.../providers/opsgenie/operators/opsgenie.py | 3 +-
.../airflow/providers/oracle/operators/oracle.py | 3 +-
.../providers/oracle/transfers/oracle_to_oracle.py | 3 +-
.../providers/papermill/operators/papermill.py | 3 +-
.../airflow/providers/pinecone/hooks/pinecone.py | 2 +-
.../providers/pinecone/operators/pinecone.py | 3 +-
.../airflow/providers/postgres/hooks/postgres.py | 3 +-
.../providers/postgres/operators/postgres.py | 3 +-
.../src/airflow/providers/presto/hooks/presto.py | 3 +-
.../providers/presto/transfers/gcs_to_presto.py | 3 +-
.../airflow/providers/qdrant/operators/qdrant.py | 3 +-
.../providers/redis/operators/redis_publish.py | 3 +-
.../airflow/providers/redis/sensors/redis_key.py | 3 +-
.../providers/redis/sensors/redis_pub_sub.py | 3 +-
.../providers/salesforce/hooks/salesforce.py | 3 +-
.../airflow/providers/salesforce/operators/bulk.py | 3 +-
.../providers/samba/transfers/gcs_to_samba.py | 3 +-
.../segment/operators/segment_track_event.py | 3 +-
.../airflow/providers/sendgrid/utils/emailer.py | 3 +-
.../providers/sftp/decorators/sensors/sftp.py | 3 +-
providers/src/airflow/providers/sftp/hooks/sftp.py | 3 +-
.../src/airflow/providers/sftp/operators/sftp.py | 3 +-
.../src/airflow/providers/sftp/sensors/sftp.py | 3 +-
.../src/airflow/providers/sftp/triggers/sftp.py | 3 +-
.../providers/singularity/operators/singularity.py | 3 +-
.../src/airflow/providers/slack/hooks/slack.py | 3 +-
.../airflow/providers/slack/notifications/slack.py | 3 +-
.../src/airflow/providers/slack/operators/slack.py | 3 +-
.../providers/slack/operators/slack_webhook.py | 3 +-
.../providers/slack/transfers/base_sql_to_slack.py | 3 +-
.../providers/slack/transfers/sql_to_slack.py | 3 +-
.../slack/transfers/sql_to_slack_webhook.py | 3 +-
.../src/airflow/providers/slack/utils/__init__.py | 3 +-
providers/src/airflow/providers/smtp/hooks/smtp.py | 3 +-
.../airflow/providers/smtp/notifications/smtp.py | 3 +-
.../src/airflow/providers/smtp/operators/smtp.py | 3 +-
.../providers/snowflake/decorators/snowpark.py | 3 +-
.../airflow/providers/snowflake/hooks/snowflake.py | 3 +-
.../providers/snowflake/operators/snowflake.py | 5 +-
.../providers/snowflake/operators/snowpark.py | 3 +-
.../snowflake/transfers/copy_into_snowflake.py | 3 +-
.../snowflake/triggers/snowflake_trigger.py | 3 +-
.../airflow/providers/sqlite/operators/sqlite.py | 3 +-
providers/src/airflow/providers/ssh/hooks/ssh.py | 3 +-
.../src/airflow/providers/ssh/operators/ssh.py | 3 +-
.../src/airflow/providers/standard/CHANGELOG.rst | 21 +
.../src/airflow/providers/standard/__init__.py | 2 +-
.../airflow/providers/standard/hooks/subprocess.py | 2 +-
.../airflow/providers/standard/operators/bash.py | 3 +-
.../providers/standard/operators/datetime.py | 3 +-
.../standard/operators/generic_transfer.py | 3 +-
.../airflow/providers/standard/operators/python.py | 4 +-
.../providers/standard/operators/trigger_dagrun.py | 5 +-
.../providers/standard/operators/weekday.py | 3 +-
.../src/airflow/providers/standard/provider.yaml | 10 +-
.../src/airflow/providers/standard/sensors/bash.py | 10 +-
.../providers/standard/sensors/date_time.py | 7 +-
.../providers/standard/sensors/filesystem.py | 7 +-
.../airflow/providers/standard/sensors/python.py | 3 +-
.../src/airflow/providers/standard/sensors/time.py | 4 +-
.../providers/standard/sensors/time_delta.py | 2 +-
.../airflow/providers/standard/sensors/weekday.py | 3 +-
.../providers/standard/triggers}/__init__.py | 0
.../providers/standard}/triggers/external_task.py | 44 +-
.../airflow/providers/standard}/triggers/file.py | 14 +-
.../providers/standard}/triggers/temporal.py | 15 +-
.../providers/standard}/utils/sensor_helper.py | 0
.../airflow/providers/tableau/operators/tableau.py | 3 +-
.../airflow/providers/tableau/sensors/tableau.py | 3 +-
.../providers/telegram/operators/telegram.py | 3 +-
.../providers/teradata/operators/teradata.py | 3 +-
.../teradata/operators/teradata_compute_cluster.py | 3 +-
.../teradata/transfers/azure_blob_to_teradata.py | 3 +-
.../providers/teradata/transfers/s3_to_teradata.py | 3 +-
.../teradata/transfers/teradata_to_teradata.py | 3 +-
.../teradata/triggers/teradata_compute_cluster.py | 3 +-
.../src/airflow/providers/trino/hooks/trino.py | 3 +-
.../src/airflow/providers/trino/operators/trino.py | 3 +-
.../providers/trino/transfers/gcs_to_trino.py | 3 +-
.../src/airflow/providers/vertica/hooks/vertica.py | 3 +-
.../airflow/providers/vertica/operators/vertica.py | 3 +-
.../airflow/providers/weaviate/hooks/weaviate.py | 13 +-
.../providers/weaviate/operators/weaviate.py | 3 +-
.../airflow/providers/yandex/operators/dataproc.py | 3 +-
.../src/airflow/providers/yandex/operators/yq.py | 3 +-
providers/src/airflow/providers/ydb/hooks/ydb.py | 3 +-
.../src/airflow/providers/ydb/operators/ydb.py | 2 +-
providers/tests/amazon/aws/hooks/test_neptune.py | 2 +-
providers/tests/amazon/aws/hooks/test_rds.py | 3 +-
.../tests/amazon/aws/operators/test_bedrock.py | 3 +-
.../tests/amazon/aws/operators/test_comprehend.py | 3 +-
.../aws/operators/test_emr_create_job_flow.py | 14 +-
providers/tests/amazon/aws/operators/test_glue.py | 3 +-
.../amazon/aws/operators/test_glue_crawler.py | 3 +-
.../amazon/aws/operators/test_glue_databrew.py | 2 +-
.../amazon/aws/operators/test_kinesis_analytics.py | 3 +-
.../tests/amazon/aws/operators/test_neptune.py | 2 +-
.../aws/operators/test_sagemaker_notebook.py | 2 +-
.../tests/amazon/aws/utils/eks_test_constants.py | 3 +-
providers/tests/amazon/aws/utils/eks_test_utils.py | 5 +-
providers/tests/amazon/aws/waiters/test_emr.py | 2 +-
.../tests/apache/kafka/operators/test_produce.py | 2 +-
.../tests/common/sql/operators/test_sql_execute.py | 3 +-
.../tests/databricks/hooks/test_databricks_sql.py | 9 +-
.../tests/edge/executors/test_edge_executor.py | 59 +-
.../tests/edge/worker_api/routes/test_rpc_api.py | 3 +-
.../api_endpoints/test_asset_endpoint.py | 2 +-
.../tests/google/cloud/hooks/test_bigquery.py | 2 +-
.../tests/google/cloud/hooks/test_datacatalog.py | 3 +-
.../tests/google/cloud/hooks/test_os_login.py | 3 +-
.../tests/google/cloud/openlineage/test_utils.py | 137 +-
.../google/cloud/operators/test_datacatalog.py | 3 +-
.../tests/google/cloud/operators/test_dataplex.py | 22 +
.../tests/google/cloud/operators/test_translate.py | 205 ++-
.../cloud/transfers/test_bigquery_to_bigquery.py | 332 +++-
.../google/cloud/transfers/test_bigquery_to_gcs.py | 21 +-
.../google/cloud/transfers/test_gcs_to_bigquery.py | 11 +-
providers/tests/microsoft/conftest.py | 3 +-
.../tests/openlineage/plugins/test_adapter.py | 23 +
.../tests/openlineage/plugins/test_execution.py | 1 -
.../tests/openlineage/plugins/test_listener.py | 59 +-
providers/tests/standard/operators/test_python.py | 3 +-
providers/tests/standard/sensors/test_time.py | 2 +-
.../tests/standard/triggers}/__init__.py | 0
.../tests/standard}/triggers/test_external_task.py | 57 +-
.../tests/standard}/triggers/test_file.py | 6 +-
.../tests/standard}/triggers/test_temporal.py | 52 +-
.../cloud/cloud_sql/example_cloud_sql_query.py | 3 +-
.../cloud/cloud_sql/example_cloud_sql_query_iam.py | 3 +-
.../cloud/cloud_sql/example_cloud_sql_query_ssl.py | 3 +-
.../cloud/translate/example_translate_dataset.py | 153 ++
pyproject.toml | 19 +-
scripts/ci/install_breeze.sh | 2 +-
.../ci/pre_commit/check_common_sql_dependency.py | 2 +-
scripts/ci/pre_commit/check_deferrable_default.py | 2 +-
scripts/ci/pre_commit/check_deprecations.py | 4 +-
.../ci/pre_commit/common_precommit_black_utils.py | 4 +-
.../decorator_operator_implements_custom_name.py | 2 +-
.../ci/pre_commit/update_providers_dependencies.py | 4 +-
scripts/ci/pre_commit/validate_operators_init.py | 8 +-
scripts/ci/pre_commit/vendor_k8s_json_schema.py | 2 +-
scripts/ci/testing/summarize_captured_warnings.py | 6 +-
scripts/ci/testing/summarize_junit_failures.py | 4 +-
scripts/cov/other_coverage.py | 2 -
scripts/docker/entrypoint_ci.sh | 11 +-
scripts/in_container/run_migration_reference.py | 3 +-
.../in_container/run_provider_yaml_files_check.py | 3 +-
scripts/in_container/verify_providers.py | 25 +-
scripts/tools/setup_breeze | 2 +-
task_sdk/pyproject.toml | 4 +-
.../src/airflow/sdk/definitions/asset/__init__.py | 33 +-
.../airflow/sdk/definitions/asset/decorators.py | 3 +
task_sdk/src/airflow/sdk/definitions/dag.py | 6 +-
tests/always/test_secrets_local_filesystem.py | 7 +-
.../api_connexion/endpoints/test_asset_endpoint.py | 2 +-
.../endpoints/test_dag_run_endpoint.py | 4 +-
tests/api_fastapi/conftest.py | 9 +
.../core_api/routes/public/test_assets.py | 2 +-
.../core_api/routes/public/test_config.py | 2 +-
.../core_api/routes/public/test_dag_run.py | 16 +-
.../core_api/routes/public/test_dags.py | 4 +-
.../core_api/routes/public/test_event_logs.py | 5 +-
.../core_api/routes/public/test_extra_links.py | 221 +++
.../core_api/routes/public/test_import_error.py | 3 +-
.../api_fastapi/core_api/routes/public/test_job.py | 165 ++
.../api_fastapi/core_api/routes/public/test_log.py | 377 +++++
.../core_api/routes/public/test_task_instances.py | 788 ++++++++-
.../api_fastapi/core_api/routes/ui/test_config.py | 115 ++
tests/api_fastapi/core_api/routes/ui/test_dags.py | 2 +-
.../endpoints/test_rpc_api_endpoint.py | 3 +-
tests/charts/helm_template_generator.py | 4 +-
tests/cli/commands/test_dag_command.py | 2 +-
tests/cli/commands/test_fastapi_api_command.py | 18 +-
tests/cli/commands/test_internal_api_command.py | 12 +-
.../cli/commands/test_rotate_fernet_key_command.py | 34 +-
tests/cli/commands/test_task_command.py | 22 +-
tests/cli/commands/test_webserver_command.py | 7 +-
tests/cli/test_cli_parser.py | 14 +-
tests/core/test_configuration.py | 11 +-
tests/core/test_settings.py | 9 +-
tests/dag_processing/test_job_runner.py | 8 +-
tests/dags/test_only_empty_tasks.py | 2 +-
tests/decorators/test_python.py | 23 +-
.../cli/commands/test_celery_command.py | 10 +-
.../integration/executors/test_celery_executor.py | 14 +-
tests/jobs/test_scheduler_job.py | 102 +-
tests/jobs/test_triggerer_job.py | 2 +-
tests/models/test_dag.py | 7 +-
tests/models/test_dagcode.py | 67 +-
tests/models/test_dagrun.py | 3 +-
tests/models/test_serialized_dag.py | 5 -
tests/models/test_trigger.py | 3 +-
tests/operators/test_trigger_dagrun.py | 7 +-
tests/plugins/test_plugins_manager.py | 26 +-
tests/sensors/test_external_task_sensor.py | 2 +-
tests/sensors/test_filesystem.py | 2 +-
.../serialization/serializers/test_serializers.py | 22 +-
tests/serialization/test_dag_serialization.py | 29 +-
tests/serialization/test_serialized_objects.py | 2 +-
tests/ti_deps/deps/test_trigger_rule_dep.py | 3 +-
tests/utils/test_cli_util.py | 14 +-
tests/utils/test_db_cleanup.py | 10 +-
tests/utils/test_entry_points.py | 2 +-
tests/utils/test_session.py | 4 +-
tests/utils/test_usage_data_collection.py | 5 +-
tests/www/test_app.py | 5 +-
tests/www/views/conftest.py | 3 +-
tests/www/views/test_views_grid.py | 44 +
tests_common/_internals/capture_warnings.py | 7 +-
tests_common/pytest_plugin.py | 3 +-
.../test_utils/format_datetime.py | 17 +-
tests_common/test_utils/gcp_system_helpers.py | 10 +-
tests_common/test_utils/mock_operators.py | 4 +-
tests_common/test_utils/reset_warning_registry.py | 2 +-
946 files changed, 12666 insertions(+), 4800 deletions(-)
rename .github/workflows/{check-providers.yml => test-provider-packages.yml}
(68%)
copy airflow/api_fastapi/{execution_api/datamodels/variable.py =>
core_api/base.py} (79%)
rename tests/triggers/__init__.py =>
airflow/api_fastapi/core_api/datamodels/extra_links.py (82%)
copy airflow/api_fastapi/core_api/datamodels/{version.py => log.py} (86%)
copy airflow/api_fastapi/core_api/datamodels/{dag_stats.py => ui/config.py}
(56%)
copy airflow/{api_connexion/endpoints/extra_link_endpoint.py =>
api_fastapi/core_api/routes/public/extra_links.py} (55%)
create mode 100644 airflow/api_fastapi/core_api/routes/public/job.py
create mode 100644 airflow/api_fastapi/core_api/routes/public/log.py
create mode 100644 airflow/api_fastapi/core_api/routes/ui/config.py
create mode 100644 newsfragments/44300.bugfix.rst
copy airflow/api_fastapi/execution_api/datamodels/xcom.py =>
providers/src/airflow/providers/common/compat/standard/triggers.py (70%)
copy {airflow/api_connexion =>
providers/src/airflow/providers/standard/triggers}/__init__.py (100%)
rename {airflow =>
providers/src/airflow/providers/standard}/triggers/external_task.py (80%)
rename {airflow => providers/src/airflow/providers/standard}/triggers/file.py
(85%)
rename {airflow =>
providers/src/airflow/providers/standard}/triggers/temporal.py (88%)
rename {airflow =>
providers/src/airflow/providers/standard}/utils/sensor_helper.py (100%)
copy {airflow/api_connexion => providers/tests/standard/triggers}/__init__.py
(100%)
rename {tests => providers/tests/standard}/triggers/test_external_task.py (86%)
rename {tests => providers/tests/standard}/triggers/test_file.py (91%)
rename {tests => providers/tests/standard}/triggers/test_temporal.py (71%)
create mode 100644
providers/tests/system/google/cloud/translate/example_translate_dataset.py
create mode 100644 tests/api_fastapi/core_api/routes/public/test_extra_links.py
create mode 100644 tests/api_fastapi/core_api/routes/public/test_job.py
create mode 100644 tests/api_fastapi/core_api/routes/public/test_log.py
create mode 100644 tests/api_fastapi/core_api/routes/ui/test_config.py
copy airflow/api_fastapi/core_api/datamodels/trigger.py =>
tests_common/test_utils/format_datetime.py (70%)
