This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch move-first-provider-to-separate-project
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 1cf19b8489f Move first provider (airbyte) to a separate project
add 9178f8f0b1f Data Interval Date validation of trigger Dag form (#45223)
add c9badd7e670 Implement AlloyDB create/update/delete instance operators
(#45241)
add 60cd5ad302d Introducing get_run_data_interval on LazyDeserializedDAG
(#45211)
add af130c0df1c AIP-72: Push XCom on Task Return (#45245)
add 7f2b8ef5acf Fixed the endless reschedule (#45224)
add aab2b882427 Fix test collection for Connection and Variables for
non-db tests (#45249)
add 9be59712a89 Remove Python <3.9 code from main (#45252)
add 2dc236576ff Fix XCom value deserialization in Task SDK (#45254)
add 61412b3af83 Add HTTP retry handling into task SDK api.client (#45121)
add 51fea3e7fb3 Add directory transfer support for SFTPOperator (#44126)
add 0efd9e6a2fa Upgrade to latest Helm version (#45258)
add 6020a26ed4d Delete variable button on variable list page (#45238)
add a22faa5921b loop scheduler before running dag in docker tests (#45262)
add 11cdd97d2d2 Import Variable API (#45265)
add 7229e2fe832 Edit variable button on variable list page (#45251)
add 2a78648848d Update Cohere to 5.13.4 v2 API (#45267)
add 9a4d14ca5b5 Simplify caching mechanisms for CI and PROD images (#45266)
add e7a89c31ac5 Move first provider (airbyte) to a separate project
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1cf19b8489f)
\
N -- N -- N refs/heads/move-first-provider-to-separate-project
(e7a89c31ac5)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/actions/checkout_target_commit/action.yml | 81 --
.github/actions/post_tests_success/action.yml | 4 +-
.github/actions/prepare_all_ci_images/action.yml | 72 ++
.../actions/prepare_breeze_and_image/action.yml | 38 +-
.github/actions/prepare_single_ci_image/action.yml | 47 +
.github/workflows/additional-ci-image-checks.yml | 9 +-
.github/workflows/additional-prod-image-tests.yml | 47 +-
.github/workflows/basic-tests.yml | 1 -
.github/workflows/build-images.yml | 264 -----
.github/workflows/ci-image-build.yml | 75 +-
.github/workflows/ci-image-checks.yml | 40 +-
.github/workflows/ci.yml | 164 +--
.github/workflows/finalize-tests.yml | 9 -
.github/workflows/generate-constraints.yml | 25 +-
.github/workflows/helm-tests.yml | 12 +-
.github/workflows/integration-system-tests.yml | 28 +-
.github/workflows/k8s-tests.yml | 73 +-
.github/workflows/prod-image-build.yml | 119 +--
.github/workflows/prod-image-extra-checks.yml | 7 +-
.github/workflows/push-image-cache.yml | 60 +-
.github/workflows/run-unit-tests.yml | 12 +-
.github/workflows/special-tests.yml | 10 -
.github/workflows/task-sdk-tests.yml | 12 +-
.github/workflows/test-provider-packages.yml | 26 +-
Dockerfile.ci | 20 +-
.../api_fastapi/core_api/datamodels/variables.py | 8 +
.../api_fastapi/core_api/openapi/v1-generated.yaml | 92 ++
.../core_api/routes/public/variables.py | 59 +-
airflow/sensors/base.py | 36 +-
airflow/serialization/serialized_objects.py | 18 +-
airflow/ui/openapi-gen/queries/common.ts | 3 +
airflow/ui/openapi-gen/queries/queries.ts | 44 +
airflow/ui/openapi-gen/requests/schemas.gen.ts | 37 +
airflow/ui/openapi-gen/requests/services.gen.ts | 32 +
airflow/ui/openapi-gen/requests/types.gen.ts | 51 +
.../src/components/TriggerDag/TriggerDAGForm.tsx | 56 +-
.../src/pages/Variables/DeleteVariableButton.tsx | 44 -
.../ui/src/pages/Variables/EditVariableButton.tsx | 44 -
.../AddVariableButton.tsx} | 32 +-
.../ManageVariable/DeleteVariableButton.tsx | 86 ++
.../ManageVariable/EditVariableButton.tsx | 86 ++
.../VariableForm.tsx} | 56 +-
airflow/ui/src/pages/Variables/Variables.tsx | 10 +-
airflow/ui/src/queries/useAddVariable.ts | 22 +-
.../{useDagParsing.ts => useDeleteVariable.ts} | 35 +-
.../{useAddVariable.ts => useEditVariable.ts} | 36 +-
airflow/ui/src/queries/useTrigger.ts | 61 +-
contributing-docs/testing/unit_tests.rst | 7 +
dev/breeze/doc/06_managing_docker_images.rst | 64 +-
dev/breeze/doc/ci/01_ci_environment.md | 97 +-
dev/breeze/doc/ci/02_images.md | 76 +-
dev/breeze/doc/ci/04_selective_checks.md | 18 +-
dev/breeze/doc/ci/05_workflows.md | 201 ++--
.../doc/ci/{07_debugging.md => 06_debugging.md} | 7 +-
dev/breeze/doc/ci/06_diagrams.md | 466 ---------
dev/breeze/doc/ci/07_running_ci_locally.md | 129 +++
dev/breeze/doc/ci/08_running_ci_locally.md | 141 ---
dev/breeze/doc/ci/README.md | 5 +-
dev/breeze/doc/images/image_artifacts.png | Bin 0 -> 47666 bytes
dev/breeze/doc/images/output_ci-image.svg | 16 +-
dev/breeze/doc/images/output_ci-image.txt | 2 +-
dev/breeze/doc/images/output_ci-image_build.svg | 180 ++--
dev/breeze/doc/images/output_ci-image_build.txt | 2 +-
dev/breeze/doc/images/output_ci-image_load.svg | 144 +++
dev/breeze/doc/images/output_ci-image_load.txt | 1 +
dev/breeze/doc/images/output_ci-image_pull.svg | 68 +-
dev/breeze/doc/images/output_ci-image_pull.txt | 2 +-
dev/breeze/doc/images/output_ci-image_save.svg | 128 +++
dev/breeze/doc/images/output_ci-image_save.txt | 1 +
dev/breeze/doc/images/output_ci-image_verify.svg | 56 +-
dev/breeze/doc/images/output_ci-image_verify.txt | 2 +-
.../doc/images/output_k8s_build-k8s-image.svg | 54 +-
.../doc/images/output_k8s_build-k8s-image.txt | 2 +-
.../doc/images/output_k8s_run-complete-tests.svg | 82 +-
.../doc/images/output_k8s_run-complete-tests.txt | 2 +-
dev/breeze/doc/images/output_prod-image.svg | 16 +-
dev/breeze/doc/images/output_prod-image.txt | 2 +-
dev/breeze/doc/images/output_prod-image_build.svg | 198 ++--
dev/breeze/doc/images/output_prod-image_build.txt | 2 +-
dev/breeze/doc/images/output_prod-image_load.svg | 132 +++
dev/breeze/doc/images/output_prod-image_load.txt | 1 +
dev/breeze/doc/images/output_prod-image_pull.svg | 68 +-
dev/breeze/doc/images/output_prod-image_pull.txt | 2 +-
dev/breeze/doc/images/output_prod-image_save.svg | 128 +++
dev/breeze/doc/images/output_prod-image_save.txt | 1 +
dev/breeze/doc/images/output_prod-image_verify.svg | 56 +-
dev/breeze/doc/images/output_prod-image_verify.txt | 2 +-
...put_release-management_generate-constraints.svg | 58 +-
...put_release-management_generate-constraints.txt | 2 +-
.../output_setup_check-all-params-in-groups.svg | 74 +-
.../output_setup_check-all-params-in-groups.txt | 2 +-
.../output_setup_regenerate-command-images.svg | 20 +-
.../output_setup_regenerate-command-images.txt | 2 +-
dev/breeze/doc/images/output_shell.svg | 204 ++--
dev/breeze/doc/images/output_shell.txt | 2 +-
dev/breeze/doc/images/output_start-airflow.svg | 130 ++-
dev/breeze/doc/images/output_start-airflow.txt | 2 +-
dev/breeze/doc/images/output_static-checks.svg | 36 +-
dev/breeze/doc/images/output_static-checks.txt | 2 +-
.../output_testing_core-integration-tests.svg | 42 +-
.../output_testing_core-integration-tests.txt | 2 +-
.../doc/images/output_testing_core-tests.svg | 90 +-
.../doc/images/output_testing_core-tests.txt | 2 +-
.../images/output_testing_docker-compose-tests.svg | 44 +-
.../images/output_testing_docker-compose-tests.txt | 2 +-
.../doc/images/output_testing_helm-tests.svg | 34 +-
.../doc/images/output_testing_helm-tests.txt | 2 +-
.../output_testing_providers-integration-tests.svg | 42 +-
.../output_testing_providers-integration-tests.txt | 2 +-
.../doc/images/output_testing_providers-tests.svg | 108 +-
.../doc/images/output_testing_providers-tests.txt | 2 +-
.../output_testing_python-api-client-tests.svg | 86 +-
.../output_testing_python-api-client-tests.txt | 2 +-
.../doc/images/output_testing_system-tests.svg | 42 +-
.../doc/images/output_testing_system-tests.txt | 2 +-
.../doc/images/output_testing_task-sdk-tests.svg | 42 +-
.../doc/images/output_testing_task-sdk-tests.txt | 2 +-
.../src/airflow_breeze/commands/ci_commands.py | 12 -
.../airflow_breeze/commands/ci_image_commands.py | 153 ++-
.../commands/ci_image_commands_config.py | 30 +-
.../commands/common_image_options.py | 36 +-
.../src/airflow_breeze/commands/common_options.py | 18 +-
.../airflow_breeze/commands/developer_commands.py | 24 +-
.../commands/developer_commands_config.py | 3 -
.../airflow_breeze/commands/kubernetes_commands.py | 74 +-
.../commands/kubernetes_commands_config.py | 2 -
.../commands/production_image_commands.py | 127 ++-
.../commands/production_image_commands_config.py | 29 +-
.../commands/release_management_commands.py | 6 -
.../commands/release_management_commands_config.py | 1 -
.../airflow_breeze/commands/testing_commands.py | 29 +-
.../commands/testing_commands_config.py | 4 -
dev/breeze/src/airflow_breeze/global_constants.py | 2 +-
.../airflow_breeze/params/common_build_params.py | 25 +-
.../src/airflow_breeze/params/shell_params.py | 9 +-
.../airflow_breeze/utils/docker_command_utils.py | 5 +-
dev/breeze/src/airflow_breeze/utils/image.py | 55 +-
dev/breeze/src/airflow_breeze/utils/platforms.py | 6 +-
.../src/airflow_breeze/utils/selective_checks.py | 8 +-
dev/breeze/tests/test_shell_params.py | 12 -
docker_tests/test_docker_compose_quick_start.py | 1 +
.../operators/cloud/alloy_db.rst | 42 +
generated/provider_dependencies.json | 2 +-
.../src/airflow/providers/cohere/hooks/cohere.py | 70 +-
.../providers/cohere/operators/embedding.py | 25 +-
.../src/airflow/providers/cohere/provider.yaml | 2 +-
.../providers/google/cloud/hooks/alloy_db.py | 312 +++++-
.../providers/google/cloud/operators/alloy_db.py | 443 +++++++--
providers/src/airflow/providers/sftp/hooks/sftp.py | 46 +
.../src/airflow/providers/sftp/operators/sftp.py | 12 +-
providers/tests/cohere/hooks/test_cohere.py | 13 +-
providers/tests/cohere/operators/test_embedding.py | 18 +-
.../tests/google/cloud/hooks/test_alloy_db.py | 2 +-
.../tests/google/cloud/operators/test_alloy_db.py | 1041 ++++++++++++++++----
providers/tests/microsoft/azure/fs/test_adls.py | 8 +
providers/tests/microsoft/azure/hooks/test_adx.py | 5 +
.../tests/microsoft/azure/hooks/test_base_azure.py | 7 +-
.../azure/hooks/test_container_registry.py | 7 +
.../microsoft/azure/hooks/test_container_volume.py | 7 +
.../tests/microsoft/azure/hooks/test_cosmos.py | 7 +
.../microsoft/azure/hooks/test_data_factory.py | 6 +
providers/tests/microsoft/azure/hooks/test_wasb.py | 4 +
providers/tests/sftp/hooks/test_sftp.py | 17 +
providers/tests/sftp/operators/test_sftp.py | 30 +
.../google/cloud/alloy_db/example_alloy_db.py | 72 +-
pyproject.toml | 1 +
scripts/ci/cleanup_docker.sh | 5 +-
scripts/ci/constraints/ci_commit_constraints.sh | 3 -
scripts/ci/docker-compose/base.yml | 2 +-
.../ci_start_arm_instance_and_connect_to_docker.sh | 91 --
scripts/ci/images/ci_stop_arm_instance.sh | 30 -
.../ci/pre_commit/update_providers_dependencies.py | 2 +-
scripts/docker/entrypoint_ci.sh | 10 +-
task_sdk/pyproject.toml | 1 +
task_sdk/src/airflow/sdk/api/client.py | 28 +
.../src/airflow/sdk/execution_time/task_runner.py | 51 +-
task_sdk/tests/api/test_client.py | 157 ++-
task_sdk/tests/execution_time/conftest.py | 9 +
task_sdk/tests/execution_time/test_context.py | 39 +-
task_sdk/tests/execution_time/test_task_runner.py | 290 ++++--
.../core_api/routes/public/test_variables.py | 115 +++
.../commands/remote_commands/test_task_command.py | 2 +
tests/dag_processing/test_collection.py | 33 +-
tests/decorators/test_python.py | 10 +-
tests/sensors/test_base.py | 285 +++++-
185 files changed, 5942 insertions(+), 3937 deletions(-)
delete mode 100644 .github/actions/checkout_target_commit/action.yml
create mode 100644 .github/actions/prepare_all_ci_images/action.yml
create mode 100644 .github/actions/prepare_single_ci_image/action.yml
delete mode 100644 .github/workflows/build-images.yml
delete mode 100644 airflow/ui/src/pages/Variables/DeleteVariableButton.tsx
delete mode 100644 airflow/ui/src/pages/Variables/EditVariableButton.tsx
rename airflow/ui/src/pages/Variables/{AddVariableModal.tsx =>
ManageVariable/AddVariableButton.tsx} (65%)
create mode 100644
airflow/ui/src/pages/Variables/ManageVariable/DeleteVariableButton.tsx
create mode 100644
airflow/ui/src/pages/Variables/ManageVariable/EditVariableButton.tsx
rename airflow/ui/src/pages/Variables/{AddVariableForm.tsx =>
ManageVariable/VariableForm.tsx} (79%)
copy airflow/ui/src/queries/{useDagParsing.ts => useDeleteVariable.ts} (62%)
copy airflow/ui/src/queries/{useAddVariable.ts => useEditVariable.ts} (65%)
rename dev/breeze/doc/ci/{07_debugging.md => 06_debugging.md} (93%)
delete mode 100644 dev/breeze/doc/ci/06_diagrams.md
create mode 100644 dev/breeze/doc/ci/07_running_ci_locally.md
delete mode 100644 dev/breeze/doc/ci/08_running_ci_locally.md
create mode 100644 dev/breeze/doc/images/image_artifacts.png
create mode 100644 dev/breeze/doc/images/output_ci-image_load.svg
create mode 100644 dev/breeze/doc/images/output_ci-image_load.txt
create mode 100644 dev/breeze/doc/images/output_ci-image_save.svg
create mode 100644 dev/breeze/doc/images/output_ci-image_save.txt
create mode 100644 dev/breeze/doc/images/output_prod-image_load.svg
create mode 100644 dev/breeze/doc/images/output_prod-image_load.txt
create mode 100644 dev/breeze/doc/images/output_prod-image_save.svg
create mode 100644 dev/breeze/doc/images/output_prod-image_save.txt
delete mode 100755
scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh
delete mode 100755 scripts/ci/images/ci_stop_arm_instance.sh
