This is an automated email from the ASF dual-hosted git repository.
ephraimanierobi pushed a change to branch v2-9-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 2d53c1089f Update RELEASE_NOTES.rst
new 3646de384e Add multi-team diagrams (#38861)
new 0b1502a27d Fix `sql_alchemy_engine_args` config example (#38971)
new 4518856395 Update testing_packages.rst (#38996)
new e4a4e2daf5 Fix stacklevel for TaskContextLogger (#39142)
new 0c2d53e14b fix(io.path): add missing conn_id to string representation
of ObjectStoragePath (#39313)
new de98856211 Add support for OrbStack in breeze (#38725)
new 6d183e7d1a Do not provide deprecated `execution_date` in
`@apply_lineage` (#39327)
new 2e612ba99c Remove unused index `idx_last_scheduling_decision` on
`dag_run` table (#39275)
new c4624fd336 docs: fix environment variable names when section name has
dot in it (#39312)
new 35623740d2 Fix TaskHandlerWithCustomFormatter now adds prefix only
once (#38502)
new dff4a1283c Add whitespace after inline literal in docs (#39401)
new ea3e24a00b Fix static file caching is disabled in Airflow Webserver.
(#39345)
new 9b259f627f Fix HTTP 500 Internal Server Error if DAG is triggered with
bad params (#39409)
new c7606afa73 Fix typo sensitive masking words in docs (#39415)
new 1bd3ad1f05 Updating S3LogLink with an invalid bucket link (#39424)
new a74c52d7bb Fix custom actions in security manager `has_access` (#39421)
new 2d88ccab1a Refactor `SafeDogStatsdLogger` to use `get_validator` to
enable pattern matching (#39370)
new c2f93bdefd Update note about restarting triggerer proccess (#39436)
new 55791def1c Only heartbeat if necessary in backfill loop (#39399)
new a76bb7bd57 Resolve SA warnings in migrations scripts (#39418)
new 29a95a0cf8 Use non-dev version for FAB Provider (#39452)
new 96224a5f59 Move core system tests outside of providers system tests
(#39335)
new 82550753d5 Update docker-compose command (#39504)
new a6e3b6ccff Adding note for provider dependencies (#39512)
new 5b58faeec2 Add Cache-Control "no-store" to all dynamically generated
content (#39550)
new f09c1c336d Update best-practices.rst: fix Connection.get ->
Connection. get_connection_from_secrets (#39560)
new 2845cfa4bc Change sorting order of parallel test types (#39579)
new c49a204a9e Fix typo in Auth Manager docs (#39598)
new b515a8e966 Fix stacklevel for _log_state helper (#39596)
new 685b81b9d3 Docs: Update tracking-user-activity.rst (#39611)
new c3e914b71a fix nit in pg set-up doc (#39628)
new 349fb56885 Remove mysql/postgres from extras before determining the
installation_command_flags (#39610)
new 7348fd2636 Doc fix: Remove misplaced backquotes in ``faq.rst`` (#39661)
new fbcf2bfeed Fix #35946: Visible DAG RUN doesn't point to the same dag
run id (#38365)
new 6a954dafb5 Change dataset URI validation to raise warning instead of
error in Airflow 2.9 (#39670)
new bff9da8a81 Update plugins.rst examples to use pyproject.toml over
setup.py (#39665)
new 6db05894d7 Reraise exception from strict dataset URI checks (#39719)
new e2086f4b18 More typing in TimeSensor and TimeSensorAsync (#39696)
new 1b26fb7882 Fetch served logs also when task attempt is up for retry
and no remote logs available (#39496)
new 967d66af52 Better typing for BaseOperator `defer` (#39742)
new e968e04863 Fix example_branch_operator failing in python 3.12 (#39783)
new bca0e5e387 Limit concurrent downloads by UV (#39810)
new 762e1a84c1 Remove 'legacy' definition for `CronDataIntervalTimetable`
(#39780)
new 5e7cd0eb26 Add max_consecutive_failed_dag_runs in API spec (#39830)
new 7e23854c1c Also limit concurrent uv downloads when building (#39852)
new 45e18a3f72 Change type definition for `provider_info_cache` decorator
(#39750)
new 7a0fb85008 Remove DAG Run Add option from FAB view (#39881)
new e4baada284 Use SKIP LOCKED instead of NOWAIT in mini scheduler (#39745)
new ebb74b28de Improve visibility of links / variables / other configs in
Configuration Reference (#39916)
new 670b255cba Fix Mark Instance state buttons stay disabled if user lacks
permission (#37451). (#38732)
The 50 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
Dockerfile | 22 +-
Dockerfile.ci | 22 +-
PROVIDERS.rst | 11 +
airflow/__init__.py | 23 +-
.../api_connexion/endpoints/dag_run_endpoint.py | 3 +-
airflow/api_connexion/openapi/v1.yaml | 8 +
airflow/config_templates/config.yml | 390 ++++++++++++---------
airflow/datasets/__init__.py | 15 +-
airflow/example_dags/example_branch_operator.py | 4 +-
airflow/io/path.py | 6 +
airflow/jobs/backfill_job_runner.py | 9 +-
airflow/lineage/__init__.py | 8 +-
airflow/metrics/datadog_logger.py | 16 +-
.../0093_2_2_0_taskinstance_keyed_to_dagrun.py | 5 +-
.../0102_2_3_0_switch_xcom_table_to_use_run_id.py | 18 +-
...3_0_migrate_rtif_to_use_run_id_and_map_index.py | 2 +-
.../0105_2_3_0_add_map_index_to_taskfail.py | 2 +-
..._2_9_2_remove_idx_last_scheduling_decision_.py} | 30 +-
airflow/models/baseoperator.py | 3 +-
airflow/models/dagrun.py | 1 -
airflow/models/taskinstance.py | 10 +-
airflow/providers_manager.py | 26 +-
airflow/sensors/date_time.py | 6 +-
airflow/sensors/time_delta.py | 6 +-
airflow/sensors/time_sensor.py | 12 +-
airflow/utils/db.py | 1 +
airflow/utils/log/file_task_handler.py | 8 +-
airflow/utils/log/task_context_logger.py | 2 +-
.../log/task_handler_with_custom_formatter.py | 3 +-
airflow/www/app.py | 6 +
airflow/www/extensions/init_security.py | 9 +
airflow/www/security_manager.py | 2 +-
airflow/www/static/js/dag/details/Header.tsx | 4 +-
.../taskInstance/taskActions/ClearInstance.tsx | 5 +-
.../taskInstance/taskActions/MarkInstanceAs.tsx | 5 +-
airflow/www/static/js/types/api-generated.ts | 6 +
airflow/www/static/js/utils/index.test.ts | 4 +-
airflow/www/static/js/utils/index.ts | 2 +-
airflow/www/templates/airflow/grid.html | 1 +
airflow/www/views.py | 7 +-
contributing-docs/testing/testing_packages.rst | 41 +--
.../airflow_breeze/commands/testing_commands.py | 4 +-
.../airflow_breeze/utils/docker_command_utils.py | 2 +-
.../logging-monitoring/tracking-user-activity.rst | 4 +-
.../authoring-and-scheduling/deferring.rst | 2 +-
.../authoring-and-scheduling/plugins.rst | 11 +-
docs/apache-airflow/best-practices.rst | 2 +-
docs/apache-airflow/core-concepts/auth-manager.rst | 2 +-
docs/apache-airflow/core-concepts/dag-run.rst | 2 +-
docs/apache-airflow/faq.rst | 2 +-
docs/apache-airflow/howto/define-extra-link.rst | 6 +-
.../howto/operator/external_task_sensor.rst | 2 +-
docs/apache-airflow/howto/set-up-database.rst | 1 -
docs/apache-airflow/img/airflow_erd.sha256 | 2 +-
docs/apache-airflow/img/airflow_erd.svg | 8 +-
..._team_airflow_architecture_with_grpc_api.md5sum | 1 +
...lti_team_airflow_architecture_with_grpc_api.png | Bin 0 -> 647436 bytes
...lti_team_airflow_architecture_with_grpc_api.py} | 38 +-
...am_airflow_architecture_without_grpc_api.md5sum | 1 +
..._team_airflow_architecture_without_grpc_api.png | Bin 0 -> 597552 bytes
..._team_airflow_architecture_without_grpc_api.py} | 92 ++---
...diagram_multitenant_airflow_architecture.md5sum | 1 -
.../diagram_multitenant_airflow_architecture.png | Bin 601270 -> 0 bytes
docs/apache-airflow/index.rst | 7 +
docs/apache-airflow/migrations-ref.rst | 5 +-
.../security/secrets/mask-sensitive-values.rst | 2 +-
docs/apache-airflow/templates-ref.rst | 2 +-
docs/apache-airflow/tutorial/pipeline.rst | 4 +-
docs/conf.py | 3 +-
docs/exts/includes/sections-and-options.rst | 8 +-
docs/spelling_wordlist.txt | 2 +
hatch_build.py | 3 +-
pyproject.toml | 2 +-
scripts/docker/common.sh | 2 +
scripts/docker/install_airflow.sh | 20 +-
scripts/in_container/_in_container_utils.sh | 2 +
tests/always/test_example_dags.py | 2 +-
.../endpoints/test_dag_run_endpoint.py | 13 +-
tests/cli/commands/test_config_command.py | 12 +-
tests/core/test_stats.py | 14 +-
tests/datasets/test_dataset.py | 29 +-
tests/io/test_path.py | 5 +
.../system/core}/__init__.py | 0
.../core/example_external_task_child_deferrable.py | 2 +-
.../example_external_task_parent_deferrable.py | 2 +-
tests/system/providers/core/__init__.py | 16 -
tests/utils/test_log_handlers.py | 24 +-
.../test_task_handler_with_custom_formatter.py | 24 +-
tests/www/test_security_manager.py | 36 +-
89 files changed, 696 insertions(+), 492 deletions(-)
copy
airflow/migrations/versions/{0127_2_7_0_add_custom_operator_name_column.py =>
0141_2_9_2_remove_idx_last_scheduling_decision_.py} (58%)
create mode 100644
docs/apache-airflow/img/diagram_multi_team_airflow_architecture_with_grpc_api.md5sum
create mode 100644
docs/apache-airflow/img/diagram_multi_team_airflow_architecture_with_grpc_api.png
copy docs/apache-airflow/img/{diagram_multitenant_airflow_architecture.py =>
diagram_multi_team_airflow_architecture_with_grpc_api.py} (87%)
create mode 100644
docs/apache-airflow/img/diagram_multi_team_airflow_architecture_without_grpc_api.md5sum
create mode 100644
docs/apache-airflow/img/diagram_multi_team_airflow_architecture_without_grpc_api.png
rename docs/apache-airflow/img/{diagram_multitenant_airflow_architecture.py =>
diagram_multi_team_airflow_architecture_without_grpc_api.py} (73%)
delete mode 100644
docs/apache-airflow/img/diagram_multitenant_airflow_architecture.md5sum
delete mode 100644
docs/apache-airflow/img/diagram_multitenant_airflow_architecture.png
copy {airflow/api_connexion => tests/system/core}/__init__.py (100%)
rename tests/system/{providers =>
}/core/example_external_task_child_deferrable.py (97%)
rename tests/system/{providers =>
}/core/example_external_task_parent_deferrable.py (98%)
delete mode 100644 tests/system/providers/core/__init__.py
