This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch v3-0-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 6dea327e0bc Refresh breeze documentation hashes in v3-0-test
discard 7fe5a47deb5 Bump task-sdk version to 1.0.0
discard 86df5fc565c Update RELEASE_NOTES.rst
discard e08d1793541 Update Airflow version to 3.0.0
discard d4661c02c87 Update default branches for 3-0
add 9fcba3da080 Fix bug in Serialization of templated fields set at
Runtime (#49144)
add b563f1ba9a1 Rewrite data pipeline tutorial to no longer use deprecated
PostgresOperator (#49147)
add be3befa0efc Bump trove-classifiers in /airflow-core (#49134)
add 82a8d4f8b32 Stabilize min provider version update (#49151)
add 8ebdd14de2f Fix isoformat for Python < 3.11 (#49155)
add 1172599b456 Bump trove-classifiers from 2025.3.19.19 to 2025.4.11.15
(#49133)
add 4fa0eec9d47 Help pip to find appropriate boto for aiobotocore (#49166)
add 0ecc99f8510 Add `jason810496` in codeowners (#49174)
add 9dcce2f71b8 Fixing DatabricksNotebookOperator invalid dependency graph
issue (#48492)
add eecbd216ab0 Move celery integration tests to celery provider. (#49178)
add 0c883c5be7c Remove dag_version as a create_dagrun argument (#49148)
add 1781dc9d5fc AWS Batch Operators/Sensors inherit AWS Base classes
(#49172)
add 9b130c6f718 Fix generation of local provider documentation index
(#49183)
add 4743694b16f Added step to install docker compose in MacOs (#47979)
add 0ca0f17996c Remove unused db method in k8s provider (#49186)
add 4add064816b Implement `Variable.delete` method in task SDK (#49141)
add fdf7f77224f Fix broken link in development index (#49192)
add 9f5e76f053d Add inventory of providers using DB (#49189)
add baa1cc2d3f6 chore: use object type hint for __eq__ method (#48900)
add 9c11f39e990 chore: make the __enter__ method return Self instead of
the class type (#48902)
add 4c8966ef8ac Silence non-user-actionable warning about forks+threads in
macOS & Py 3.12+ (#49185)
add efdca941103 Use BaseXCom serialize_value when objectstorage_threshold
is less than given input (#49173)
add cb79c51303e mark sendgrid provider as not ready (#49203)
add e9c46a3a6fe Add link to precommit tool install guide (#49200)
add 000366dcdd8 Fix finding assets in serialized mapped operator (#49210)
add 2a7dea10f2b Fix PostgresHook Json serialization (#49120)
add 4cdc7be004f update md5 type hints to respect PEP570 (#49195)
add 4ab223db3cd Logging the loaded secrets backends in worker (#49205)
add bc45acf4ccb Move SQS message queue code example from core to provider
docs (#49208)
new 8298f77ec01 Update default branches for 3-0
new 6a48e1bba06 Update Airflow version to 3.0.0
new 122197c8ba7 Update RELEASE_NOTES.rst
new 8425dbdbb5b Bump task-sdk version to 1.0.0
new bcbb014a005 Refresh breeze documentation hashes in v3-0-test
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6dea327e0bc)
\
N -- N -- N refs/heads/v3-0-test (bcbb014a005)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/CODEOWNERS | 8 +-
.../authoring-and-scheduling/event-scheduling.rst | 35 +---
airflow-core/docs/img/tutorial-pipeline-1.png | Bin 66411 -> 0 bytes
airflow-core/docs/img/tutorial-pipeline-2.png | Bin 137595 -> 0 bytes
.../ui-dark/tutorial_pipeline_add_connection.png | Bin 0 -> 109852 bytes
.../img/ui-dark/tutorial_pipeline_dag_list.png | Bin 0 -> 70666 bytes
.../tutorial_pipeline_dag_overview_processed.png | Bin 0 -> 107191 bytes
.../ui-light/tutorial_pipeline_add_connection.png | Bin 0 -> 114291 bytes
.../img/ui-light/tutorial_pipeline_dag_list.png | Bin 0 -> 70320 bytes
.../tutorial_pipeline_dag_overview_processed.png | Bin 0 -> 108052 bytes
airflow-core/docs/tutorial/pipeline.rst | 204 ++++++++++++---------
airflow-core/pyproject.toml | 2 +-
airflow-core/src/airflow/api/common/trigger_dag.py | 3 -
.../api_fastapi/core_api/routes/public/assets.py | 2 -
.../api_fastapi/core_api/routes/public/dag_run.py | 2 -
.../api_fastapi/execution_api/routes/variables.py | 18 +-
.../src/airflow/cli/commands/task_command.py | 4 +-
.../src/airflow/dag_processing/bundles/base.py | 4 +-
.../src/airflow/dag_processing/processor.py | 8 +-
.../airflow/example_dags/example_bash_decorator.py | 2 +-
.../src/airflow/jobs/scheduler_job_runner.py | 6 -
.../src/airflow/metrics/base_stats_logger.py | 6 +-
airflow-core/src/airflow/metrics/datadog_logger.py | 4 +-
airflow-core/src/airflow/metrics/otel_logger.py | 4 +-
airflow-core/src/airflow/metrics/protocols.py | 13 +-
airflow-core/src/airflow/metrics/statsd_logger.py | 4 +-
airflow-core/src/airflow/models/asset.py | 16 +-
airflow-core/src/airflow/models/backfill.py | 3 -
airflow-core/src/airflow/models/dag.py | 7 +-
airflow-core/src/airflow/models/dag_version.py | 14 +-
airflow-core/src/airflow/models/variable.py | 38 +++-
.../airflow/serialization/serialized_objects.py | 17 +-
.../src/airflow/ti_deps/deps/base_ti_dep.py | 4 +-
.../airflow/ti_deps/deps/task_not_running_dep.py | 2 +-
.../src/airflow/ti_deps/deps/valid_state_dep.py | 6 +-
airflow-core/src/airflow/timetables/_cron.py | 4 +-
airflow-core/src/airflow/timetables/interval.py | 2 +-
airflow-core/src/airflow/timetables/simple.py | 2 +-
airflow-core/src/airflow/traces/tracer.py | 5 +-
airflow-core/src/airflow/utils/db.py | 2 +-
airflow-core/src/airflow/utils/hashlib_wrapper.py | 6 +-
.../src/airflow/utils/operator_resources.py | 4 +-
airflow-core/src/airflow/utils/sqlalchemy.py | 4 +-
airflow-core/tests/unit/api_fastapi/conftest.py | 2 -
.../execution_api/versions/head/test_variables.py | 29 +++
.../tests/unit/cli/commands/test_task_command.py | 3 -
.../tests/unit/dag_processing/test_processor.py | 35 ++++
airflow-core/tests/unit/jobs/test_scheduler_job.py | 155 ++++------------
airflow-core/tests/unit/models/test_dag.py | 3 -
airflow-core/tests/unit/models/test_dagrun.py | 2 -
.../tests/unit/models/test_taskinstance.py | 14 +-
.../unit/serialization/test_serialized_objects.py | 18 ++
contributing-docs/03_contributors_quick_start.rst | 9 +-
contributing-docs/04_how_to_contribute.rst | 2 +-
contributing-docs/09_testing.rst | 2 +-
dev/airflow_perf/scheduler_dag_execution_timing.py | 1 -
dev/breeze/doc/03_developer_tasks.rst | 4 +
...management_generate-issue-content-providers.svg | 6 +-
...management_generate-issue-content-providers.txt | 2 +-
...e-management_prepare-provider-distributions.svg | 6 +-
...e-management_prepare-provider-distributions.txt | 2 +-
...e-management_prepare-provider-documentation.svg | 6 +-
...e-management_prepare-provider-documentation.txt | 2 +-
.../output_testing_core-integration-tests.svg | 4 +-
.../output_testing_core-integration-tests.txt | 2 +-
.../output_testing_providers-integration-tests.svg | 4 +-
.../output_testing_providers-integration-tests.txt | 2 +-
.../airflow_breeze/commands/developer_commands.py | 3 +-
dev/breeze/src/airflow_breeze/global_constants.py | 3 +-
.../src/airflow_breeze/params/shell_params.py | 6 +-
.../tests/test_pytest_args_for_test_types.py | 1 +
dev/breeze/tests/test_selective_checks.py | 4 +-
dev/provider_db_inventory.py | 105 +++++++++++
.../sphinx_exts/docs_build/dev_index_generator.py | 8 +-
.../docs_build/dev_index_template.html.jinja2 | 2 +-
devel-common/src/tests_common/pytest_plugin.py | 2 -
docs/spelling_wordlist.txt | 1 +
providers/amazon/docs/operators/batch.rst | 5 +
providers/amazon/pyproject.toml | 7 +-
.../providers/amazon/aws/hooks/batch_client.py | 11 ++
.../providers/amazon/aws/operators/batch.py | 75 ++++----
.../airflow/providers/amazon/aws/sensors/batch.py | 85 ++++-----
.../tests/unit/amazon/aws/operators/test_batch.py | 40 ++--
.../tests/integration}/__init__.py | 0
.../celery/tests/integration/celery}/__init__.py | 0
.../integration/celery}/test_celery_executor.py | 0
.../cncf/kubernetes/template_rendering.py | 17 --
.../cncf/kubernetes/test_template_rendering.py | 32 +---
.../airflow/providers/common/io/xcom/backend.py | 18 +-
.../io/tests/unit/common/io/xcom/test_backend.py | 28 +++
providers/common/messaging/docs/triggers.rst | 18 +-
.../messaging/example_message_queue_trigger.py | 16 +-
.../providers/databricks/operators/databricks.py | 48 +++--
.../databricks/operators/databricks_workflow.py | 18 +-
.../unit/databricks/operators/test_databricks.py | 9 +-
.../operators/test_databricks_workflow.py | 8 +-
.../airflow/providers/postgres/hooks/postgres.py | 12 +-
.../tests/unit/postgres/hooks/test_postgres.py | 19 ++
providers/sendgrid/provider.yaml | 2 +-
providers/sendgrid/pyproject.toml | 2 +-
.../standard/sensors/test_external_task_sensor.py | 1 -
pyproject.toml | 2 +-
.../ci/pre_commit/update_airflow_pyproject_toml.py | 10 +-
task-sdk/src/airflow/sdk/api/client.py | 11 ++
task-sdk/src/airflow/sdk/bases/operator.py | 5 +-
task-sdk/src/airflow/sdk/definitions/variable.py | 10 +
task-sdk/src/airflow/sdk/execution_time/comms.py | 6 +
task-sdk/src/airflow/sdk/execution_time/context.py | 20 ++
.../src/airflow/sdk/execution_time/supervisor.py | 13 +-
.../src/airflow/sdk/execution_time/task_runner.py | 4 +-
task-sdk/src/airflow/sdk/io/store.py | 18 +-
task-sdk/src/airflow/sdk/log.py | 6 +
task-sdk/tests/task_sdk/api/test_client.py | 15 ++
.../task_sdk/execution_time/test_supervisor.py | 10 +
.../task_sdk/execution_time/test_task_runner.py | 16 +-
task-sdk/tests/task_sdk/io/test_path.py | 2 +-
116 files changed, 918 insertions(+), 616 deletions(-)
delete mode 100644 airflow-core/docs/img/tutorial-pipeline-1.png
delete mode 100644 airflow-core/docs/img/tutorial-pipeline-2.png
create mode 100644
airflow-core/docs/img/ui-dark/tutorial_pipeline_add_connection.png
create mode 100644 airflow-core/docs/img/ui-dark/tutorial_pipeline_dag_list.png
create mode 100644
airflow-core/docs/img/ui-dark/tutorial_pipeline_dag_overview_processed.png
create mode 100644
airflow-core/docs/img/ui-light/tutorial_pipeline_add_connection.png
create mode 100644
airflow-core/docs/img/ui-light/tutorial_pipeline_dag_list.png
create mode 100644
airflow-core/docs/img/ui-light/tutorial_pipeline_dag_overview_processed.png
create mode 100755 dev/provider_db_inventory.py
copy providers/{git/src/airflow => celery/tests/integration}/__init__.py (100%)
copy {airflow-core/src/airflow/api =>
providers/celery/tests/integration/celery}/__init__.py (100%)
rename {airflow-core/tests/integration/executors =>
providers/celery/tests/integration/celery}/test_celery_executor.py (100%)
