This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/pip/airflow-core/pip-dependency-updates-72f83f7f84
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 9c88e308fc5 Bump the pip-dependency-updates group across 3 directories
with 3 updates
add d3fa64a0e52 Bump mermaid from 11.14.0 to 11.15.0 in
/airflow-core/src/airflow/ui (#69132)
add 4772f9373e7 Make PostgreSQL SQLAlchemy driver explicit
(postgresql+psycopg2://) (#68314)
add 52cd4e52df5 Add bundle_name to serialized dag (#68583)
add d224b0446fb Rename assets list-by-alias to list-aliases in airflowctl
(#68522)
add 1bb880df42f Add team_name tags to Amazon executor metrics (#69072)
add 926a8c62c55 Fix Celery worker JSON logging config for teams (#69139)
add 29270789031 Fix the prerequisites release 3.2 (#69119)
add 83c93f13440 Fix missed rename of BaseStateBackend to BaseStoreBackend
(#69160)
add 81101f3e60f Add durable execution to DatabricksSubmitRunOperator
(#68974)
add 3ead1c8039f Parallelize per-dag auth checks in KeycloakAuthManager
(#69107)
add 4ee7bd9fcb4 Add team_name tag to Edge executor sync metric (#69005)
add 9fcb064c832 Change Clickhouse lifecycle to incubation (#69166)
add 1b6ff208d30 Test fix in main Celery worker tests leaking logging
handler onto captured stdout (#69163)
add 25c0b3f473e KubernetesExecutor: self.completed adoption set is never
drained (#68674)
add 08ccc89ecd6 Bump mermaid from 11.15.0 to 11.16.0 in
/airflow-core/src/airflow/ui (#69137)
add ff52f44e92b Fix N+1 queries in trigger asset event submission (#65367)
add 1667c6b356f Introducing object store backend for task and asset state
store (#68283)
add b176ec91dc5 Gate provider release on artifact completeness check
before vote (#69141)
add 3b13e593ac6 Fix cursor pagination dropping rows when sorting by a
nullable column (#68869)
add 052c26b046f Bump the fab-ui-package-updates group across 1 directory
with 3 updates (#69133)
add 7790bb52994 Fix Dag detail page 500 for Dags without a fileloc #69035
(#69110)
add bfd7689273d Add OpenLineage system tests for new emission_policy
feature (#69181)
add eb119d4047c Bump the pip-dependency-updates group across 3 directories
with 3 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9c88e308fc5)
\
N -- N -- N
refs/heads/dependabot/pip/airflow-core/pip-dependency-updates-72f83f7f84
(eb119d4047c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
airflow-core/docs/core-concepts/multi-team.rst | 8 +-
airflow-core/docs/howto/set-up-database.rst | 6 +-
airflow-core/docs/installation/prerequisites.rst | 4 +-
airflow-core/newsfragments/68314.improvement.rst | 1 +
.../src/airflow/api_fastapi/common/cursors.py | 66 +--
.../api_fastapi/core_api/datamodels/dags.py | 2 +-
.../api_fastapi/core_api/openapi/_private_ui.yaml | 4 +-
.../core_api/openapi/v2-rest-api-generated.yaml | 8 +-
.../api_fastapi/core_api/routes/public/dag_run.py | 7 +-
.../core_api/routes/public/task_instances.py | 11 +-
.../src/airflow/config_templates/config.yml | 4 +-
airflow-core/src/airflow/configuration.py | 7 +-
airflow-core/src/airflow/dag_processing/dagbag.py | 4 +
airflow-core/src/airflow/models/serialized_dag.py | 1 +
airflow-core/src/airflow/models/trigger.py | 6 +-
.../src/airflow/serialization/definitions/dag.py | 2 +
airflow-core/src/airflow/serialization/schema.json | 1 +
.../airflow/ui/openapi-gen/requests/schemas.gen.ts | 27 +-
.../airflow/ui/openapi-gen/requests/types.gen.ts | 6 +-
airflow-core/src/airflow/ui/package.json | 2 +-
airflow-core/src/airflow/ui/pnpm-lock.yaml | 342 ++++++++--------
.../Code/FileLocation.test.tsx} | 27 +-
.../airflow/ui/src/pages/Dag/Code/FileLocation.tsx | 14 +-
.../tests/unit/api_fastapi/common/test_cursors.py | 123 +++++-
.../core_api/routes/public/test_dag_run.py | 34 ++
.../core_api/routes/public/test_dags.py | 20 +
.../core_api/routes/public/test_task_instances.py | 101 +++++
airflow-core/tests/unit/core/test_configuration.py | 39 +-
.../tests/unit/dag_processing/test_dagbag.py | 23 ++
airflow-core/tests/unit/models/test_base.py | 4 +-
.../tests/unit/models/test_serialized_dag.py | 24 ++
airflow-core/tests/unit/models/test_trigger.py | 22 +
.../unit/serialization/test_dag_serialization.py | 16 +
airflow-core/tests/unit/state/test_metastore.py | 2 +-
airflow-core/tests/unit/utils/test_db.py | 2 +-
airflow-ctl/docs/images/command_hashes.txt | 2 +-
airflow-ctl/docs/images/output_assets.svg | 128 +++---
airflow-ctl/pyproject.toml | 2 +-
.../src/airflowctl/api/datamodels/generated.py | 4 +-
airflow-ctl/src/airflowctl/api/operations.py | 4 +-
airflow-ctl/src/airflowctl/ctl/help_texts.yaml | 2 +-
.../tests/airflow_ctl/api/test_operations.py | 4 +-
dev/README_RELEASE_PROVIDERS.md | 14 +
.../operators/postgres_local_executor.cfg | 2 +-
.../aws/executors/aws_lambda/lambda_executor.py | 10 +-
.../amazon/aws/executors/batch/batch_executor.py | 11 +-
.../amazon/aws/executors/ecs/ecs_executor.py | 10 +-
.../executors/aws_lambda/test_lambda_executor.py | 27 ++
.../aws/executors/batch/test_batch_executor.py | 25 ++
.../amazon/aws/executors/ecs/test_ecs_executor.py | 27 +-
providers/celery/provider.yaml | 2 +-
.../airflow/providers/celery/cli/celery_command.py | 6 +-
.../airflow/providers/celery/get_provider_info.py | 2 +-
.../tests/unit/celery/cli/test_celery_command.py | 11 +
providers/clickhousedb/provider.yaml | 2 +-
.../kubernetes/executors/kubernetes_executor.py | 32 +-
.../executors/test_kubernetes_executor.py | 84 +++-
providers/common/io/docs/index.rst | 1 +
providers/common/io/docs/state_store_backend.rst | 81 ++++
providers/common/io/provider.yaml | 28 ++
.../providers/common/io/get_provider_info.py | 21 +
.../providers/common/io/state_store}/__init__.py | 0
.../providers/common/io/state_store/backend.py | 246 +++++++++++
.../tests/unit/common/io/state_store}/__init__.py | 0
.../unit/common/io/state_store/test_backend.py | 274 +++++++++++++
providers/databricks/docs/operators/submit_run.rst | 39 ++
.../providers/databricks/operators/databricks.py | 103 ++++-
.../unit/databricks/operators/test_databricks.py | 238 ++++++++++-
.../providers/edge3/executors/edge_executor.py | 3 +-
.../unit/edge3/executors/test_edge_executor.py | 24 ++
.../fab/src/airflow/providers/fab/www/package.json | 6 +-
.../src/airflow/providers/fab/www/pnpm-lock.yaml | 450 +++++++++++----------
.../keycloak/auth_manager/keycloak_auth_manager.py | 30 +-
.../auth_manager/test_keycloak_auth_manager.py | 32 ++
... example_openlineage_policy_conf_locked_dag.py} | 17 +-
...ple_openlineage_policy_conf_source_code_dag.py} | 21 +-
...ample_openlineage_policy_dag_emit_false_dag.py} | 21 +-
...ple_openlineage_policy_dag_events_false_dag.py} | 31 +-
...le_openlineage_policy_dag_override_task_dag.py} | 17 +-
...ple_openlineage_policy_extract_metadata_dag.py} | 46 ++-
...ample_openlineage_policy_full_task_info_dag.py} | 15 +-
.../example_openlineage_policy_hook_lineage_dag.py | 107 +++++
... example_openlineage_policy_source_code_dag.py} | 28 +-
...mple_openlineage_policy_task_emit_false_dag.py} | 26 +-
.../openlineage_policy_conf_locked_dag.json | 26 ++
.../openlineage_policy_conf_source_code_dag.json | 50 +++
.../openlineage_policy_dag_emit_false_dag.json | 65 +++
.../openlineage_policy_dag_events_false_dag.json | 69 ++++
.../openlineage_policy_dag_override_task_dag.json | 50 +++
.../openlineage_policy_extract_metadata_dag.json | 50 +++
... => openlineage_policy_full_task_info_dag.json} | 20 +-
.../openlineage_policy_hook_lineage_dag.json | 174 ++++++++
.../openlineage_policy_source_code_dag.json | 68 ++++
.../openlineage_policy_task_emit_false_dag.json | 57 +++
.../ci/prek/check_airflowctl_command_coverage.py | 2 +-
task-sdk/pyproject.toml | 2 +-
task-sdk/src/airflow/sdk/definitions/dag.py | 2 +
task-sdk/tests/task_sdk/definitions/test_asset.py | 21 +-
task-sdk/tests/task_sdk/definitions/test_dag.py | 9 +
99 files changed, 3213 insertions(+), 738 deletions(-)
create mode 100644 airflow-core/newsfragments/68314.improvement.rst
copy
airflow-core/src/airflow/ui/src/pages/{Connections/NothingFoundInfo.test.tsx =>
Dag/Code/FileLocation.test.tsx} (59%)
create mode 100644 providers/common/io/docs/state_store_backend.rst
copy {airflow-core/src/airflow/_shared =>
providers/common/io/src/airflow/providers/common/io/state_store}/__init__.py
(100%)
create mode 100644
providers/common/io/src/airflow/providers/common/io/state_store/backend.py
copy {airflow-core/src/airflow/_shared =>
providers/common/io/tests/unit/common/io/state_store}/__init__.py (100%)
create mode 100644
providers/common/io/tests/unit/common/io/state_store/test_backend.py
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_docs_file_dag.py
=> example_openlineage_policy_conf_locked_dag.py} (72%)
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_docs_file_dag.py
=> example_openlineage_policy_conf_source_code_dag.py} (66%)
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_versioned_dag.py
=> example_openlineage_policy_dag_emit_false_dag.py} (73%)
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_base_simple_dag.py
=> example_openlineage_policy_dag_events_false_dag.py} (59%)
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_docs_file_dag.py
=> example_openlineage_policy_dag_override_task_dag.py} (70%)
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_setup_teardown_dag.py
=> example_openlineage_policy_extract_metadata_dag.py} (56%)
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_docs_file_dag.py
=> example_openlineage_policy_full_task_info_dag.py} (77%)
create mode 100644
providers/openlineage/tests/system/openlineage/example_openlineage_policy_hook_lineage_dag.py
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_docs_file_dag.py
=> example_openlineage_policy_source_code_dag.py} (60%)
copy
providers/openlineage/tests/system/openlineage/{example_openlineage_base_simple_dag.py
=> example_openlineage_policy_task_emit_false_dag.py} (72%)
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_conf_locked_dag.json
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_conf_source_code_dag.json
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_dag_emit_false_dag.json
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_dag_events_false_dag.json
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_dag_override_task_dag.json
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_extract_metadata_dag.json
copy
providers/openlineage/tests/system/openlineage/expected_events/{openlineage_mapped_simple_dag.json
=> openlineage_policy_full_task_info_dag.json} (52%)
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_hook_lineage_dag.json
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_source_code_dag.json
create mode 100644
providers/openlineage/tests/system/openlineage/expected_events/openlineage_policy_task_emit_false_dag.json
