This is an automated email from the ASF dual-hosted git repository.
pierrejeambrun pushed a change to branch v2-5-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 5c0aabb290 Fix inconsitencies in checking edit permissions for a DAG
(#20346)
new 7fe2ceaad6 Update doc for API clients release policy (#28521)
new b42ace20df Move provider issue generation to breeze (#28352)
new a0ec6fe9fc Improving the release process (#27829)
new 1456f11a99 listener plugin example added (#27905)
new 97912c84dd logging poke info when external dag is not none and task_id
and task_ids are none (#28097)
new d6657fdcf4 Add Public Interface description to Airflow documentation
(#28300)
new 2a19dd7741 Fix #28391 manual task trigger from UI fails for k8s
executor (#28394)
new 13ce6725d4 introduce dag processor job (#28799)
new 76b2796817 Throttle streaming log reads (#28818)
new a833dfb720 Bump swagger-ui-dist from 3.52.0 to 4.1.3 in /airflow/www
(#28824)
new 389c074b82 More robust cleanup of executors in
test_kubernetes_executor (#28281)
new 9ad5779a54 Annotate KubernetesExecutor pods that we don't delete
(#28844)
new 9f3fecbdbc Email Config docs more explicit env var examples (#28845)
new 934e169ed1 clarify that the total_entries property isn't impact by
pagination (#28867)
new 1eba989f1b KubenetesExecutor sends state even when successful (#28871)
new 8719079355 Add dep context description for better log message (#28875)
new c22c42dbd4 Remove horizontal lines in TI logs (#28876)
new 0cb731c394 Don't get ES log template from airflow local settings
unless necessary (#28882)
new 5a8ddaedd8 Be more selective when adopting pods with
KubernetesExecutor (#28899)
new 459412b183 Switch pull-request-target to base branch of pull request
(#28921)
new 31bffa8713 Allow URI without authority and host blocks in `airflow
connections add` (#28922)
new 061338fad1 Refactor python operators/sensor tests (#28493)
new e9853c7794 Update how PythonSensor returns values from python_callable
(#28932)
new 3959765789 improve quick start guide (#28949)
new 9bf17670dc Move project and license docs down in menu to start with
developer-focused docs (#28956)
new c487daf254 Bump epoch on python dependencies in Airlfow Image (#28960)
new e64ac0464d Mark license block in doc as text (#28965)
new 20e6ee0d32 Update go client gen command (#28967)
new e2cf933058 Resolve all variables in pickled XCom iterator (#28982)
new 9891eef2ab Fix dag run trigger with a note. (#29228)
new 2a8e414364 Write action log to DB when DAG run is trigged via API
(#28998)
new 147d5fe719 fixing import error for dataset (#29007)
new 8fe9d7e477 Remove erroneous TODO comment (#29015)
new 0bab483f43 change context example to no longer us as variable (#29021)
new 94bce2b763 Only skip provider integration tests for non-main builds
(#29022)
new c2dd921d5c Annotate and simplify code samples in DAGs doc (#29027)
new 2ec4d063b6 Sanitize url_for arguments before they are passed (#29039)
The 37 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../airflow_helmchart_bug_report.yml | 2 +-
.../get-target-branch-build-scripts/action.yml | 44 +
.github/workflows/build-images.yml | 80 +-
.github/workflows/ci.yml | 42 +-
.gitignore | 3 +
BREEZE.rst | 9 +
Dockerfile.ci | 15 +-
README.md | 8 +-
airflow/__init__.py | 1 +
.../api_connexion/endpoints/dag_run_endpoint.py | 17 +-
airflow/api_connexion/openapi/v1.yaml | 4 +-
airflow/api_connexion/schemas/dag_run_schema.py | 2 +-
airflow/cli/commands/connection_command.py | 5 +-
airflow/cli/commands/dag_processor_command.py | 18 +-
airflow/cli/commands/task_command.py | 2 +-
airflow/config_templates/airflow_local_settings.py | 6 -
airflow/decorators/__init__.pyi | 2 +-
airflow/decorators/branch_python.py | 2 +-
airflow/decorators/sensor.py | 2 +
airflow/example_dags/plugins/event_listener.py | 156 +++
.../plugins/listener_plugin.py} | 12 +-
airflow/executors/kubernetes_executor.py | 87 +-
airflow/jobs/dag_processor_job.py | 69 ++
airflow/models/taskinstance.py | 12 +-
airflow/models/xcom.py | 7 +-
airflow/sensors/external_task.py | 28 +-
airflow/sensors/python.py | 5 +-
airflow/ti_deps/dep_context.py | 1 +
airflow/triggers/base.py | 2 +-
airflow/utils/log/log_reader.py | 17 +-
airflow/www/package.json | 252 ++---
airflow/www/static/js/types/api-generated.ts | 5 +-
airflow/www/views.py | 36 +-
airflow/www/yarn.lock | 8 +-
clients/gen/go.sh | 1 +
dev/README_RELEASE_AIRFLOW.md | 421 ++------
dev/README_RELEASE_PROVIDER_PACKAGES.md | 4 +-
dev/breeze/README.md | 2 +-
dev/breeze/setup.cfg | 7 +
.../commands/minor_release_command.py | 191 ++++
.../commands/release_candidate_command.py | 346 +++++++
.../src/airflow_breeze/commands/release_command.py | 291 ++++++
.../commands/release_management_commands.py | 208 +++-
.../airflow_breeze/commands/testing_commands.py | 9 +
.../src/airflow_breeze/params/shell_params.py | 1 +
.../provider_issue_TEMPLATE.md.jinja2} | 14 +-
dev/breeze/src/airflow_breeze/utils/confirm.py | 17 +
dev/breeze/src/airflow_breeze/utils/console.py | 4 +
dev/provider_packages/prepare_provider_packages.py | 164 +---
.../core-extensions/extra-links.rst | 2 +-
docs/apache-airflow-providers/index.rst | 2 +-
.../authoring-and-scheduling/plugins.rst | 2 +-
docs/apache-airflow/core-concepts/dags.rst | 120 ++-
docs/apache-airflow/howto/custom-operator.rst | 2 +-
...define_extra_link.rst => define-extra-link.rst} | 0
docs/apache-airflow/howto/email-config.rst | 22 +-
docs/apache-airflow/howto/index.rst | 3 +-
docs/apache-airflow/howto/listener-plugin.rst | 95 ++
docs/apache-airflow/howto/operator/index.rst | 4 +-
docs/apache-airflow/index.rst | 13 +-
docs/apache-airflow/license.rst | 2 +-
docs/apache-airflow/public-airflow-interface.rst | 369 +++++++
docs/apache-airflow/python-api-ref.rst | 175 ----
docs/apache-airflow/redirects.txt | 8 +-
docs/apache-airflow/start.rst | 2 +-
docs/conf.py | 9 +-
docs/spelling_wordlist.txt | 1 +
images/breeze/output-commands-hash.txt | 25 +-
images/breeze/output_ci-image.svg | 40 +-
images/breeze/output_release-management.svg | 58 +-
...t_release-management_generate-issue-content.svg | 176 ++++
images/breeze/output_setup.svg | 13 +-
.../output_setup_check-all-params-in-groups.svg | 172 ++++
.../output_setup_regenerate-command-images.svg | 44 +-
images/breeze/output_testing_integration-tests.svg | 18 +-
scripts/ci/docker-compose/_docker.env | 1 +
scripts/ci/docker-compose/base.yml | 1 +
scripts/docker/entrypoint_ci.sh | 13 +-
.../run_prepare_provider_documentation.sh | 5 -
.../endpoints/test_dag_run_endpoint.py | 16 +-
tests/cli/commands/test_connection_command.py | 67 +-
tests/cli/commands/test_dag_processor_command.py | 13 +-
tests/conftest.py | 10 +-
tests/decorators/test_python.py | 143 +--
tests/decorators/test_python_virtualenv.py | 13 -
tests/executors/test_kubernetes_executor.py | 409 ++++----
tests/models/test_taskinstance.py | 49 +-
tests/operators/test_python.py | 1003 +++++++-------------
tests/sensors/test_external_task_sensor.py | 48 +-
tests/sensors/test_python.py | 135 +--
90 files changed, 3737 insertions(+), 2207 deletions(-)
create mode 100644 .github/actions/get-target-branch-build-scripts/action.yml
create mode 100644 airflow/example_dags/plugins/event_listener.py
copy airflow/{providers/amazon/aws/utils/rds.py =>
example_dags/plugins/listener_plugin.py} (78%)
create mode 100644 airflow/jobs/dag_processor_job.py
create mode 100644
dev/breeze/src/airflow_breeze/commands/minor_release_command.py
create mode 100644
dev/breeze/src/airflow_breeze/commands/release_candidate_command.py
create mode 100644 dev/breeze/src/airflow_breeze/commands/release_command.py
rename dev/{provider_packages/PROVIDER_ISSUE_TEMPLATE.md.jinja2 =>
breeze/src/airflow_breeze/provider_issue_TEMPLATE.md.jinja2} (57%)
rename docs/apache-airflow/howto/{define_extra_link.rst =>
define-extra-link.rst} (100%)
create mode 100644 docs/apache-airflow/howto/listener-plugin.rst
create mode 100644 docs/apache-airflow/public-airflow-interface.rst
delete mode 100644 docs/apache-airflow/python-api-ref.rst
create mode 100644
images/breeze/output_release-management_generate-issue-content.svg
create mode 100644 images/breeze/output_setup_check-all-params-in-groups.svg
