This is an automated email from the ASF dual-hosted git repository.
ephraimanierobi pushed a change to branch v2-7-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
from 84ec54af92 Update RELEASE_NOTES.rst for 2.7.0
new bc1d7b03ab Fix future DagRun rarely triggered by race conditions when
max_active_runs reached its upper limit. (#31414)
new c11e81460d Fix reload gunicorn workers (#32102)
new 0655d883ae Skip served logs for non-running task try (#32561)
new 097d2bed4e Replace State by TaskInstanceState in Airflow executors
(#32627)
new 699fba373d add dag_run_ids and task_ids filter for the batch task
instance API endpoint (#32705)
new b501446a2d Pass app context to webserver_config.py (#32759)
new 0ed56c84ef Add example for list-import-errors as a CI check (#32811)
new abfe7b89ef Documentation Update to enhance Readability (#32832)
new a887f92f69 Add links to DAGRun / DAG / Task in templates-ref.rst
(#33013)
new 41d57f0908 Add links to Celery and Kubernetes executor CLI commands to
Airflow (#33143)
new fdb96229b6 Configurable health check threshold for triggerer (#33089)
new 448f4849c0 Correctly log when there are problems trying to chmod
airflow.cfg (#33118)
new 1109ea9003 aDd documentation generation for CLI commands from
executors (#33081)
new 2b312cd162 Add notes about pre-2-7 config and cli options in providers
(#33123)
new dbacacbd4d Allows to choose SSL context for SMTP provider (#33075)
new 38fc9cd823 Allows to choose SSL context for IMAP provider (#33108)
new 11d6b3c864 openlineage, bigquery: add openlineage method support for
BigQueryExecuteQueryOperator (#31293)
new 2f894ca218 openlineage: disable running listener if not configured
(#33120)
new 7af9938a92 Move openlineage configuration to provider (#33124)
new 855d4684e9 Clean `schedule_interval` usages from example dags (#33131)
new b54f503037 Fix edge cases of "migrate/create-default-connections"
(#33136)
new 86f1dc100d Split PROD image verification to a separate step in CI
(#33140)
new c80d91be62 Attempt to stabilise tests for xcom_arg_map (#33150)
new f90625bb8b docs(public airflow interface): fix link (#33147)
new 0253f6aa1b Improve back-reference generation (#33149)
new 489d3dd6e9 Give the the test_xcom_ar_map test opportunity to flush the
data (#33153)
new 127445f577 Upgrade ruff to latest 0.0.282 version in pre-commits
(#33152)
new 197789e19d Give the the test_xcom_ar_map test opportunity to flush the
data (#33153)
new cf9e3fcddd Remove redundant dict.keys() call (#33158)
new 99aaacbd64 Refactor: Simplify dict manipulation in airflow/cli (#33159)
new 473452d3b7 Add elasticsearch group to pre-2.7 defaults (#33166)
new 816d4ccfde Fix installing older airflow versions in Breeze with
openssl fix (#33171)
new 39c3b5b62c Docs typo and capitalization fixes (#33176)
new 0eb0a7a70b Fixing typo in Dockerfile (#33180)
new 78f4344e0b Refactor: Simplify code in models (#33181)
new 690f3f1216 Cleanup all sqlalchemy sessions before each test (#33190)
new 7463380047 Fix xcom view returning bytes as xcom value (#33202)
The 37 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/ci.yml | 14 +-
.pre-commit-config.yaml | 2 +-
Dockerfile | 2 +-
Dockerfile.ci | 1 -
airflow/api_connexion/endpoints/pool_endpoint.py | 4 +-
.../endpoints/task_instance_endpoint.py | 2 +
airflow/api_connexion/openapi/v1.yaml | 20 ++
.../api_connexion/schemas/task_instance_schema.py | 2 +
airflow/cli/cli_config.py | 2 +-
airflow/cli/cli_parser.py | 5 +-
airflow/cli/commands/db_command.py | 2 +-
airflow/cli/commands/provider_command.py | 4 +-
airflow/cli/commands/role_command.py | 4 +-
airflow/cli/commands/webserver_command.py | 16 +-
airflow/cli/simple_table.py | 8 +-
airflow/config_templates/config.yml | 85 ++------
airflow/config_templates/config.yml.schema.json | 29 ++-
airflow/config_templates/pre_2_7_defaults.cfg | 12 ++
airflow/config_templates/unit_tests.cfg | 3 +-
airflow/configuration.py | 11 +-
airflow/executors/base_executor.py | 25 ++-
airflow/executors/debug_executor.py | 28 +--
airflow/executors/sequential_executor.py | 6 +-
airflow/jobs/job.py | 2 +
airflow/jobs/scheduler_job_runner.py | 19 +-
airflow/jobs/triggerer_job_runner.py | 4 +-
airflow/models/base.py | 2 +-
airflow/models/baseoperator.py | 2 +-
airflow/models/dag.py | 35 ++-
airflow/models/dagbag.py | 2 +-
airflow/models/expandinput.py | 2 +-
airflow/models/taskmixin.py | 2 +-
airflow/models/trigger.py | 14 +-
.../providers/celery/executors/celery_executor.py | 17 +-
.../kubernetes/executors/kubernetes_executor.py | 18 +-
.../executors/kubernetes_executor_types.py | 5 +-
.../executors/kubernetes_executor_utils.py | 14 +-
airflow/providers/google/cloud/hooks/bigquery.py | 2 +-
.../providers/google/cloud/operators/bigquery.py | 92 +++++++-
airflow/providers/imap/CHANGELOG.rst | 12 ++
airflow/providers/imap/hooks/imap.py | 37 +++-
airflow/providers/imap/provider.yaml | 23 ++
airflow/providers/openlineage/extractors/base.py | 6 +
.../providers/openlineage/plugins/openlineage.py | 10 +-
airflow/providers/openlineage/provider.yaml | 61 ++++++
airflow/providers/openlineage/utils/utils.py | 9 +-
airflow/providers/qubole/hooks/qubole.py | 6 +-
airflow/providers/smtp/CHANGELOG.rst | 12 ++
airflow/providers/smtp/hooks/smtp.py | 20 +-
airflow/providers/smtp/provider.yaml | 24 +++
airflow/utils/db.py | 1 -
airflow/utils/log/file_task_handler.py | 12 +-
airflow/www/app.py | 4 +-
airflow/www/static/js/types/api-generated.ts | 12 ++
airflow/www/views.py | 6 +-
.../airflow_breeze/commands/developer_commands.py | 47 +++-
.../commands/release_candidate_command.py | 5 +-
.../commands/release_management_commands.py | 32 ++-
dev/breeze/src/airflow_breeze/global_constants.py | 2 +-
.../airflow_breeze/utils/add_back_references.py | 71 +++---
.../src/airflow_breeze/utils/common_options.py | 4 +-
dev/breeze/tests/test_global_constants.py | 6 +-
dev/perf/sql_queries.py | 1 -
.../connections/aws.rst | 2 +-
.../cli-ref.rst} | 20 +-
docs/apache-airflow-providers-celery/index.rst | 1 +
.../cli-ref.rst} | 15 +-
.../index.rst | 1 +
.../configurations-ref.rst | 0
docs/apache-airflow-providers-imap/index.rst | 1 +
.../configurations-ref.rst | 0
.../apache-airflow-providers-openlineage/index.rst | 1 +
.../configurations-ref.rst | 0
docs/apache-airflow-providers-smtp/index.rst | 1 +
.../dag-serialization.rst | 2 +-
.../authoring-and-scheduling/plugins.rst | 6 +-
docs/apache-airflow/cli-and-env-variables-ref.rst | 6 +
docs/apache-airflow/configurations-ref.rst | 3 +
docs/apache-airflow/howto/add-dag-tags.rst | 4 +-
docs/apache-airflow/howto/set-config.rst | 12 ++
docs/apache-airflow/howto/usage-cli.rst | 31 +++
docs/apache-airflow/public-airflow-interface.rst | 2 +-
docs/apache-airflow/security/webserver.rst | 27 +++
docs/apache-airflow/templates-ref.rst | 16 +-
docs/apache-airflow/ui.rst | 2 +-
docs/docker-stack/build.rst | 2 +-
.../exts/includes/providers-configurations-ref.rst | 6 +
docs/exts/includes/sections-and-options.rst | 31 +--
docs/helm-chart/airflow-configuration.rst | 9 -
images/breeze/output-commands-hash.txt | 4 +-
...tput_release-management_add-back-references.svg | 108 ++++++++--
newsfragments/33136.significant.rst | 5 +
scripts/ci/pre_commit/pre_commit_insert_extras.py | 4 +-
.../ci/pre_commit/pre_commit_local_yml_mounts.py | 6 +-
scripts/docker/entrypoint_ci.sh | 1 -
scripts/docker/entrypoint_prod.sh | 2 +-
scripts/in_container/_in_container_utils.sh | 13 +-
scripts/in_container/check_environment.sh | 18 +-
.../endpoints/test_task_instance_endpoint.py | 30 +++
tests/conftest.py | 9 +
tests/core/test_configuration.py | 1 -
tests/jobs/test_backfill_job.py | 2 +-
tests/jobs/test_base_job.py | 9 +-
tests/models/test_trigger.py | 86 +++-----
tests/models/test_xcom_arg_map.py | 32 +--
.../google/cloud/operators/job_details.json | 240 +++++++++++++++++++++
.../google/cloud/operators/test_bigquery.py | 91 ++++++++
tests/providers/imap/hooks/test_imap.py | 69 +++++-
.../openlineage/extractors/test_bash_extractor.py | 2 +-
.../extractors/test_python_extractor.py | 2 +-
.../openlineage/plugins/test_openlineage.py | 36 +++-
tests/providers/smtp/hooks/test_smtp.py | 103 ++++++++-
.../apache/kafka/example_dag_hello_kafka.py | 2 +-
tests/system/providers/ftp/example_ftp.py | 2 +-
.../google/cloud/compute/example_compute.py | 2 +-
.../google/cloud/compute/example_compute_igm.py | 2 +-
.../google/cloud/compute/example_compute_ssh.py | 2 +-
.../dataproc/example_dataproc_spark_deferrable.py | 2 +-
tests/ti_deps/deps/test_runnable_exec_date_dep.py | 8 +-
tests/utils/test_log_handlers.py | 16 +-
tests/www/views/test_views_tasks.py | 23 +-
121 files changed, 1611 insertions(+), 464 deletions(-)
copy docs/{apache-airflow-providers-apache-kafka/triggers.rst =>
apache-airflow-providers-celery/cli-ref.rst} (66%)
copy docs/{apache-airflow-providers-apache-hdfs/operators/index.rst =>
apache-airflow-providers-cncf-kubernetes/cli-ref.rst} (66%)
copy docs/{apache-airflow-providers-apache-hive =>
apache-airflow-providers-imap}/configurations-ref.rst (100%)
copy docs/{apache-airflow-providers-apache-hive =>
apache-airflow-providers-openlineage}/configurations-ref.rst (100%)
copy docs/{apache-airflow-providers-apache-hive =>
apache-airflow-providers-smtp}/configurations-ref.rst (100%)
create mode 100644 newsfragments/33136.significant.rst
create mode 100644 tests/providers/google/cloud/operators/job_details.json
