This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch upgrade-to-fab-4
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard 364eeaf Upgrade to FAB 4.0
add 77d4e72 Switch azure provider to azure-keyvault-secrets (#22557)
add 7418720 More explicit messages for pools and exceptions (#22569)
add 4eebabb Add production Build Image in the new Breeze (#21956)
add ab3c74e Use timetable to generate planned days for current year
(#22055)
add b5a786b Suppress import errors for providers from sources (#22579)
add 58dd3d1 Update regexp classifying changes for providers (#22593)
add b033aec Specify Alembic revision to help text for db upgrade (#22577)
add d0046cf Fix type of upgrade_to_newer_dependencies parameter (#22597)
add 6db30f3 Update our approach for executor-bound dependencies (#22573)
add c577d5d Fix providers manager tests (#22592)
add 7dd940d Fix black version to support click 8.0.0 (#22598)
add d4846e4 Update FAB to latest released from 3.4 line (3.4.5) (#22596)
add 67e2723 Log traceback only on ``DEBUG`` for KPO logs read
interruption (#22595)
add 16b0d24 Fix typo in the Pull Request "build image" if. (#22585)
add b0b69f3 Doc: Update description for executor-bound dependencies
(#22601)
add c58b5e5 Doc: Explicitly specify Py 3.10 will be supported from
Airflow 2.3.0 (#22602)
add f6e0888 Fix grammar in issue templates (#22611)
add 56235d9 Fix link to generating constraints (#22615)
add 9e66d14 Final fix for image caching (#22618)
add 8240a44 Fix failing static check (#22621)
add d041dbe Update modal buttons for mapped task instances (#22578)
add 91c958d Fix failing exec in Breeze (#22623)
add 143702e Fix /rendered-templates for mapped operator (#22396)
add 7e0e7c7 Rewrite ti.xcom_pull() to consider map indexes (#22609)
add 347e202 Bump black version for other pre-commit hooks (#22599)
add 97cf769 Fix: Add extra headers to all livy API requests instead of
only to post_batch (#22510)
add c25ee43 Use "terminate-instances" instead of "stop-instances" (#22636)
add 88165b3 Do not log the hook connection details even at DEBUG level
(#22627)
add 55ee62e Add doc for LocalFilesystemToS3Operator (#22574)
add 9798c8c Add more fields to REST API get DAG(dags/dag_id) endpoint
(#22637)
add dae5640 Set `webhook_endpoint` as templated field in
`DiscordWebhookOperator`(#22570)
add 25b62a7 Further improves image caching for Breeze (#22625)
add 7ca4e93 Add API endpoint to list mapped task instances (#22341)
add a089861 Better description for UPGRADE_TO_NEWER_DEPENDENCIES
parameter (#22644)
add da924b0 Upgrade to FAB 4.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (364eeaf)
\
N -- N -- N refs/heads/upgrade-to-fab-4 (da924b0)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 17 +-
.../ISSUE_TEMPLATE/airflow_doc_issue_report.yml | 11 +-
.../airflow_helmchart_bug_report.yml | 19 +-
.../airflow_providers_bug_report.yml | 15 +-
.github/workflows/build-images.yml | 4 +-
.github/workflows/ci.yml | 2 +
.pre-commit-config.yaml | 10 +-
BREEZE.rst | 4 +-
Dockerfile | 32 +-
Dockerfile.ci | 42 ++-
IMAGES.rst | 16 +-
README.md | 11 +-
.../api_connexion/endpoints/provider_endpoint.py | 6 +-
.../endpoints/task_instance_endpoint.py | 112 ++++++
airflow/api_connexion/openapi/v1.yaml | 172 +++++++++
airflow/api_connexion/schemas/dag_schema.py | 15 +
airflow/cli/cli_parser.py | 11 +-
airflow/cli/commands/info_command.py | 2 +-
airflow/cli/commands/pool_command.py | 8 +-
airflow/cli/commands/provider_command.py | 8 +-
airflow/decorators/base.py | 1 +
airflow/hooks/base.py | 12 -
airflow/models/abstractoperator.py | 2 +-
airflow/models/baseoperator.py | 30 +-
airflow/models/dag.py | 2 +-
airflow/models/mappedoperator.py | 31 +-
airflow/models/taskinstance.py | 162 +++++---
airflow/models/xcom.py | 6 +-
.../amazon/aws/example_dags/example_local_to_s3.py | 5 +-
.../providers/amazon/aws/transfers/local_to_s3.py | 4 +
airflow/providers/amazon/provider.yaml | 1 +
airflow/providers/apache/livy/hooks/livy.py | 14 +-
airflow/providers/celery/provider.yaml | 3 +-
airflow/providers/cncf/kubernetes/provider.yaml | 2 +-
.../providers/cncf/kubernetes/utils/pod_manager.py | 9 +-
.../providers/discord/operators/discord_webhook.py | 4 +-
airflow/providers_manager.py | 172 +++++----
airflow/serialization/serialized_objects.py | 63 ++--
airflow/www/static/css/main.css | 5 +
airflow/www/static/js/calendar.js | 16 +-
airflow/www/static/js/dag.js | 83 +++-
airflow/www/static/js/gantt.js | 9 +-
airflow/www/static/js/graph.js | 16 +-
airflow/www/static/js/tree/StatusBox.jsx | 10 +-
airflow/www/templates/airflow/calendar.html | 7 +-
airflow/www/templates/airflow/dag.html | 20 +-
airflow/www/templates/airflow/task_instance.html | 2 +-
airflow/www/views.py | 62 ++-
breeze | 11 +-
chart/dockerfiles/pgbouncer/Dockerfile | 2 +-
dev/breeze/src/airflow_breeze/breeze.py | 305 +++++++++++----
dev/breeze/src/airflow_breeze/ci/build_image.py | 8 +
dev/breeze/src/airflow_breeze/ci/build_params.py | 19 +-
dev/breeze/src/airflow_breeze/global_constants.py | 14 +
.../breeze/src/airflow_breeze/prod}/__init__.py | 0
.../src/airflow_breeze/prod/build_prod_image.py | 202 ++++++++++
dev/breeze/src/airflow_breeze/prod/prod_params.py | 380 +++++++++++++++++++
dev/breeze/src/airflow_breeze/shell/enter_shell.py | 2 +
.../airflow_breeze/utils/docker_command_utils.py | 15 +
dev/breeze/src/airflow_breeze/utils/path_utils.py | 2 +-
dev/breeze/src/airflow_breeze/utils/run_utils.py | 26 ++
.../{test_build_image.py => test_prod_image.py} | 41 +-
docker_tests/test_prod_image.py | 2 +-
.../transfer/{ftp_to_s3.rst => local_to_s3.rst} | 23 +-
.../index.rst | 2 +-
docs/docker-stack/build-arg-ref.rst | 8 +-
scripts/ci/constraints/ci_generate_constraints.sh | 2 -
scripts/ci/images/ci_stop_arm_instance.sh | 2 +-
scripts/ci/libraries/_build_images.sh | 56 ++-
.../pre_commit_inline_scripts_in_docker.py | 2 +-
.../ci/pre_commit/pre_commit_lint_dockerfile.sh | 16 +-
scripts/ci/pre_commit/pre_commit_mypy.sh | 2 +-
.../ci_make_providers_2_1_compliant.sh} | 15 +-
scripts/ci/selective_ci_checks.sh | 4 +-
scripts/docker/airflow-scheduler-autorestart.sh | 0
scripts/docker/clean-logs.sh | 0
scripts/docker/entrypoint_exec.sh | 4 +-
scripts/in_container/_in_container_utils.sh | 4 +-
setup.py | 45 ++-
tests/api_connexion/endpoints/test_dag_endpoint.py | 295 +++++++++++++++
.../test_mapped_task_instance_endpoint.py | 419 +++++++++++++++------
.../endpoints/test_provider_endpoint.py | 7 +-
.../endpoints/test_task_instance_endpoint.py | 9 +
tests/api_connexion/schemas/test_dag_schema.py | 48 +++
tests/core/test_providers_manager.py | 20 +-
tests/models/test_taskinstance.py | 33 +-
tests/serialization/test_dag_serialization.py | 24 +-
87 files changed, 2703 insertions(+), 636 deletions(-)
copy {tests/timetables => dev/breeze/src/airflow_breeze/prod}/__init__.py
(100%)
create mode 100644 dev/breeze/src/airflow_breeze/prod/build_prod_image.py
create mode 100644 dev/breeze/src/airflow_breeze/prod/prod_params.py
copy dev/breeze/tests/{test_build_image.py => test_prod_image.py} (61%)
copy docs/apache-airflow-providers-amazon/operators/transfer/{ftp_to_s3.rst =>
local_to_s3.rst} (69%)
copy scripts/ci/{images/ci_build_ci_image_on_ci.sh =>
provider_packages/ci_make_providers_2_1_compliant.sh} (69%)
mode change 100755 => 100644 scripts/docker/airflow-scheduler-autorestart.sh
mode change 100755 => 100644 scripts/docker/clean-logs.sh
