This is an automated email from the ASF dual-hosted git repository.
ephraimanierobi pushed a change to branch v2-8-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
from c28ba46e13 Exclude common-io provider
new 28897f7a42 Run triggers inline with dag test (#34642)
new 881d802629 improved visibility of tasks in ActionModal for
taskInstance (#35810)
new ecbc959812 Use ExitStack to manage mutation of secrets_backend_list in
dag.test (#34620)
new 713dfdfa23 Implement `is_authorized_variable` in AWS auth manager
(#35804)
new bc95360902 Relax mandatory requirement for start_date when
schedule=None (#35356)
new 9be2ffc304 Add a public interface for custom weight_rule
implementation (#35210)
new 9798f314dd Consolidate the call of change_state to fail or success in
the core executors (#35901)
new 2fba7bd0b3 Remove workaround for pymssql failing compilation with new
Cython (#35924)
new 54dc2b9127 Change dag grid overscroll behaviour to auto (#35717)
new 7e9b6a4f68 Revert "Prevent assignment of non JSON serializable values
to DagRun.conf dict (#35096)" (#35959)
new 90f10b199d Rename `Connection.to_json_dict` to `Connection.to_dict`
(#35894)
new 9ba72a2e0c Move `duckdb` & `pandas` import in tutorial DAG into task
(#35964)
new 7b03a11dc9 Add processor_subdir to import_error table to handle
multiple dag processors (#35956)
new f6cfd45f33 Fix airflow db shell needing an extra keypress to exit
(#35982)
new 9ea67c8749 Bump FAB to 4.3.10 (#35991)
new 8a0252d419 Add feature to build "chicken-egg" packages from sources
(#35890)
new 9281ccb6f9 Pass conn ID to ObjectStoragePath via URI (#35913)
new 72d610a354 Switch "latest" image to point to newest supported Python
version (#36003)
new e1f469bbd3 Add support for chicken-egg providers to dockerhub release
process (#36002)
new 08188ed880 [AIP-44] Introduce Pydantic model for LogTemplate (#36004)
new 4652d7fc00 Add multiselect to run state in grid view (#35403)
new d6ce328397 Change Trigger UI to use HTTP POST in web ui (#36026)
new 552fbe3120 Use dropdown instead of buttons when there are more than 10
retries in log tab (#36025)
new d265100995 34058: Fix UI Grid error when DAG has been removed. (#36028)
new f4c4a06bd8 Limit Pytest-asyncio to < 0.23.1 (#36037)
new be0fb8b11c Limit pytest-asyncio even more - to <0.23.0 (#36040)
new a2573503a6 Add the section describing the security model of DAG Author
capabilities (#36022)
new beba3b80a1 Remove pytest-asyncio upper-binding limitatin (#36046)
new be86dd37eb Add XCom tab to Grid (#35719)
new 44302838fd Update supported-versions.rst (#36058)
new a42d3d86c7 Avoid crushing container when directory is not found on rm
(#36050)
new 2a008cfb57 Update reset_user_sessions to work from either CLI or web
(#36056)
new 48d7ac44b4 Mark daskexecutor provider as removed (#35965)
new 786ae6bf33 Update RELEASE_NOTES.rst
The 34 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/actions/build-prod-images/action.yml | 12 +
.github/workflows/build-images.yml | 2 +
.github/workflows/ci.yml | 15 +
.github/workflows/release_dockerhub_image.yml | 17 +
CONTRIBUTING.rst | 20 +-
Dockerfile | 53 +-
Dockerfile.ci | 36 -
IMAGES.rst | 2 +-
INSTALL | 20 +-
RELEASE_NOTES.rst | 20 +
airflow/api_connexion/openapi/v1.yaml | 7 +
airflow/api_connexion/schemas/task_schema.py | 1 +
airflow/api_internal/endpoints/rpc_api_endpoint.py | 1 +
.../auth/managers/fab/security_manager/override.py | 48 +-
airflow/config_templates/config.yml | 13 +-
airflow/dag_processing/manager.py | 13 +-
airflow/dag_processing/processor.py | 14 +-
.../example_priority_weight_strategy.py | 69 +
airflow/example_dags/tutorial_objectstorage.py | 10 +-
airflow/executors/base_executor.py | 2 +-
airflow/executors/debug_executor.py | 8 +-
airflow/executors/executor_constants.py | 1 -
airflow/executors/executor_loader.py | 3 -
airflow/executors/sequential_executor.py | 5 +-
airflow/io/path.py | 10 +-
airflow/io/store/__init__.py | 2 +-
...2_8_0_add_priority_weight_strategy_to_task_.py} | 25 +-
...133_2_8_0_add_processor_subdir_import_error.py} | 32 +-
airflow/models/abstractoperator.py | 20 +-
airflow/models/baseoperator.py | 36 +-
airflow/models/connection.py | 11 +-
airflow/models/dag.py | 178 ++-
airflow/models/dagrun.py | 71 +-
airflow/models/errors.py | 1 +
airflow/models/mappedoperator.py | 16 +-
airflow/models/taskinstance.py | 25 +-
airflow/providers/MANAGING_PROVIDERS_LIFECYCLE.rst | 58 +
.../amazon/aws/auth_manager/avp}/__init__.py | 0
.../amazon/aws/auth_manager/avp/entities.py} | 55 +-
.../amazon/aws/auth_manager/avp/facade.py | 126 ++
.../amazon/aws/auth_manager/aws_auth_manager.py | 14 +-
.../providers/amazon/aws/auth_manager/constants.py | 4 +-
airflow/providers/amazon/aws/auth_manager/user.py | 3 +
.../aws/hooks/{sts.py => verified_permissions.py} | 32 +-
airflow/providers/amazon/provider.yaml | 25 +-
airflow/providers/daskexecutor/CHANGELOG.rst | 6 +
airflow/providers/daskexecutor/provider.yaml | 4 +-
airflow/providers/google/provider.yaml | 2 +-
airflow/providers/installed_providers.txt | 1 -
airflow/providers/microsoft/azure/provider.yaml | 2 +-
airflow/providers/microsoft/mssql/provider.yaml | 2 +-
airflow/serialization/enums.py | 1 +
airflow/serialization/pydantic/dag_run.py | 1 +
airflow/serialization/pydantic/taskinstance.py | 1 +
.../serialization/pydantic/tasklog.py | 17 +-
airflow/serialization/serialized_objects.py | 9 +-
airflow/task/priority_strategy.py | 91 ++
airflow/utils/db.py | 2 +-
airflow/utils/process_utils.py | 2 +-
airflow/utils/weight_rule.py | 6 +-
airflow/www/auth.py | 23 +-
airflow/www/jest-setup.js | 6 +
airflow/www/static/js/api/index.ts | 10 +
airflow/www/static/js/api/useTaskXcom.ts | 71 +
airflow/www/static/js/dag/details/index.tsx | 71 +-
.../js/dag/details/taskInstance/Logs/index.tsx | 57 +-
.../www/static/js/dag/details/taskInstance/Nav.tsx | 3 -
.../{Logs/LogLink.tsx => Xcom/XcomEntry.tsx} | 77 +-
.../js/dag/details/taskInstance/Xcom/index.tsx | 116 ++
.../taskInstance/taskActions/ActionModal.tsx | 2 +-
airflow/www/static/js/dag/grid/index.tsx | 2 +-
airflow/www/static/js/dag/nav/FilterBar.tsx | 91 +-
airflow/www/static/js/dag/useFilters.test.tsx | 31 +-
airflow/www/static/js/dag/useFilters.tsx | 62 +-
airflow/www/static/js/types/api-generated.ts | 10 +-
airflow/www/templates/airflow/dag.html | 10 +-
airflow/www/templates/airflow/dags.html | 7 +-
airflow/www/views.py | 19 +-
.../commands/release_management_commands.py | 68 +-
.../commands/release_management_commands_config.py | 2 +
dev/breeze/src/airflow_breeze/global_constants.py | 1 -
.../src/airflow_breeze/params/shell_params.py | 2 +
.../src/airflow_breeze/utils/common_options.py | 8 +
dev/breeze/src/airflow_breeze/utils/packages.py | 4 -
.../src/airflow_breeze/utils/selective_checks.py | 5 +
dev/breeze/src/airflow_breeze/utils/versions.py | 6 +
dev/breeze/tests/test_packages.py | 6 +-
docker_tests/test_prod_image.py | 1 -
docs/apache-airflow-providers-google/index.rst | 2 +-
.../index.rst | 2 +-
.../priority-weight.rst | 12 +-
.../apache-airflow/core-concepts/objectstorage.rst | 16 +-
docs/apache-airflow/extra-packages-ref.rst | 4 -
docs/apache-airflow/img/airflow_erd.sha256 | 2 +-
docs/apache-airflow/img/airflow_erd.svg | 1528 ++++++++++----------
.../installation/supported-versions.rst | 2 +-
docs/apache-airflow/migrations-ref.rst | 6 +-
docs/apache-airflow/security/security_model.rst | 280 ++--
docs/apache-airflow/tutorial/objectstorage.rst | 18 +-
docs/docker-stack/build-arg-ref.rst | 1 -
docs/docker-stack/changelog.rst | 8 +
.../aws/Amazon-Verified-Permissions.png | Bin 0 -> 13986 bytes
generated/provider_dependencies.json | 16 +-
images/breeze/output_build-docs.svg | 6 +-
images/breeze/output_build-docs.txt | 2 +-
images/breeze/output_prod-image_build.svg | 2 +-
images/breeze/output_prod-image_build.txt | 2 +-
...tput_release-management_add-back-references.svg | 6 +-
...tput_release-management_add-back-references.txt | 2 +-
...put_release-management_generate-constraints.svg | 58 +-
...put_release-management_generate-constraints.txt | 2 +-
...management_generate-issue-content-providers.svg | 6 +-
...management_generate-issue-content-providers.txt | 2 +-
...e-management_prepare-provider-documentation.svg | 6 +-
...e-management_prepare-provider-documentation.txt | 2 +-
...elease-management_prepare-provider-packages.svg | 6 +-
...elease-management_prepare-provider-packages.txt | 2 +-
.../output_release-management_publish-docs.svg | 6 +-
.../output_release-management_publish-docs.txt | 2 +-
...tput_release-management_release-prod-images.svg | 62 +-
...tput_release-management_release-prod-images.txt | 2 +-
...output_sbom_generate-providers-requirements.svg | 64 +-
...output_sbom_generate-providers-requirements.txt | 2 +-
scripts/docker/clean-logs.sh | 2 +-
.../docker/install_from_docker_context_files.sh | 7 +
scripts/docker/install_mssql.sh | 39 -
scripts/in_container/_in_container_utils.sh | 23 +-
setup.cfg | 8 +-
setup.py | 21 +-
.../api_connexion/endpoints/test_task_endpoint.py | 21 +-
tests/api_connexion/schemas/test_task_schema.py | 6 +-
tests/cli/commands/test_dag_command.py | 81 +-
tests/cli/commands/test_standalone_command.py | 3 -
tests/dag_processing/test_job_runner.py | 62 +
tests/executors/test_debug_executor.py | 4 +-
tests/io/test_path.py | 28 +-
tests/models/test_baseoperator.py | 12 +-
tests/models/test_dag.py | 72 +-
tests/models/test_dagrun.py | 14 -
tests/models/test_mappedoperator.py | 2 +-
tests/models/test_taskinstance.py | 1 +
.../amazon/aws/auth_manager/avp}/__init__.py | 0
.../amazon/aws/auth_manager/avp/test_entities.py | 12 +-
.../amazon/aws/auth_manager/avp/test_facade.py | 203 +++
.../aws/auth_manager/test_aws_auth_manager.py | 38 +-
.../amazon/aws/auth_manager/test_constants.py | 12 +-
.../providers/amazon/aws/auth_manager/test_user.py | 3 +
.../amazon/aws/hooks/test_verified_permissions.py | 11 +-
tests/providers/google/cloud/sensors/test_gcs.py | 4 +-
tests/sensors/test_base.py | 3 -
tests/serialization/test_dag_serialization.py | 3 +-
tests/serialization/test_serialized_objects.py | 8 +
tests/www/views/test_views_custom_user_views.py | 36 +-
tests/www/views/test_views_grid.py | 21 +
tests/www/views/test_views_tasks.py | 7 +
tests/www/views/test_views_trigger_dag.py | 20 +-
156 files changed, 3231 insertions(+), 1749 deletions(-)
create mode 100644 airflow/example_dags/example_priority_weight_strategy.py
copy airflow/migrations/versions/{0066_2_0_0_add_queued_by_job_id_to_ti.py =>
0132_2_8_0_add_priority_weight_strategy_to_task_.py} (68%)
copy
airflow/migrations/versions/{0130_2_8_0_add_owner_display_name_to_audit_log_table.py
=> 0133_2_8_0_add_processor_subdir_import_error.py} (55%)
copy airflow/{api_connexion =>
providers/amazon/aws/auth_manager/avp}/__init__.py (100%)
copy airflow/{auth/managers/utils/fab.py =>
providers/amazon/aws/auth_manager/avp/entities.py} (53%)
create mode 100644 airflow/providers/amazon/aws/auth_manager/avp/facade.py
copy airflow/providers/amazon/aws/hooks/{sts.py => verified_permissions.py}
(61%)
copy tests/dags_with_system_exit/b_test_scheduler_dags.py =>
airflow/serialization/pydantic/tasklog.py (70%)
create mode 100644 airflow/task/priority_strategy.py
create mode 100644 airflow/www/static/js/api/useTaskXcom.ts
copy airflow/www/static/js/dag/details/taskInstance/{Logs/LogLink.tsx =>
Xcom/XcomEntry.tsx} (53%)
create mode 100644
airflow/www/static/js/dag/details/taskInstance/Xcom/index.tsx
create mode 100644 docs/integration-logos/aws/Amazon-Verified-Permissions.png
copy {airflow/api_connexion =>
tests/providers/amazon/aws/auth_manager/avp}/__init__.py (100%)
copy airflow/api_connexion/schemas/version_schema.py =>
tests/providers/amazon/aws/auth_manager/avp/test_entities.py (72%)
create mode 100644 tests/providers/amazon/aws/auth_manager/avp/test_facade.py
copy airflow/api_connexion/endpoints/request_dict.py =>
tests/providers/amazon/aws/hooks/test_verified_permissions.py (77%)
