This is an automated email from the ASF dual-hosted git repository.
ashb pushed a change to branch task-loops-stack-6
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 70a0e6f55de fixup! Attribute log, asset-event and asset-state writes
to the task attempt
omit 1df025b0c9c fixup! Attribute log, asset-event and asset-state writes
to the task attempt
omit a0fccda4d0e fixup! Attribute log, asset-event and asset-state writes
to the task attempt
omit 17f78308155 Attribute log, asset-event and asset-state writes to the
task attempt
omit 31f60f70c3e fixup! Give every mapped expansion a region and store its
index as region_index
omit 09ba0d08b88 fixup! Give every mapped expansion a region and store its
index as region_index
omit 12e796ef66c Give every mapped expansion a region and store its index
as region_index
omit 2f7bed1b9f1 fixup! Pin loop definitions and carry region coordinates
through task execution
omit ac8660cc2c8 fixup! Pin loop definitions and carry region coordinates
through task execution
omit 8e97fc87016 fixup! Pin loop definitions and carry region coordinates
through task execution
omit 289fe5b3979 Pin loop definitions and carry region coordinates through
task execution
omit e650913f739 fixup! Resolve live producers by region and read their
XCom by attempt
omit c96fc80c47e Resolve live producers by region and read their XCom by
attempt
omit a6f0f2c6f7c fixup! Introduce the (internal/db level) concept of
"dynamic regions" for TIs
omit 28eacc4e201 Introduce the (internal/db level) concept of "dynamic
regions" for TIs
omit 338b4dba8d2 fixup! Add user-facing docs for the new Task Loops feature.
omit 1f7ad703b17 fixup! Add user-facing docs for the new Task Loops feature.
omit 1e4eaf25fac fixup! Add user-facing docs for the new Task Loops feature.
omit 2f47fd5be63 Add user-facing docs for the new Task Loops feature.
add 785d82da5c0 Cover native Go Dags in the go_sdk e2e test (#74411)
add dc38f84ff46 Consolidate in-process Execution API hosting (#73327)
add b8ef78f53ad Fix misleading timetable Variable example in best
practices (#73945)
add 1e404fac4ac Stop the scheduler crashing when a queued run's Dag fails
to deserialize (#74499)
add ea955744e4d Make airflow standalone discover new Dag files within
seconds (#74479)
add 0a913f21aa8 Use the configured API port in the default execution API
URL (#74478)
add 681faf7064f Add user-facing docs for the new Task Loops feature.
add c34fcb1e77d fixup! Add user-facing docs for the new Task Loops feature.
add d98b98ab8b5 fixup! Add user-facing docs for the new Task Loops feature.
add 0cd8de1c320 fixup! Add user-facing docs for the new Task Loops feature.
add 8591d22d6fe Introduce the (internal/db level) concept of "dynamic
regions" for TIs
add 205af7f2b4a fixup! Introduce the (internal/db level) concept of
"dynamic regions" for TIs
add 9eb157351cf Resolve live producers by region and read their XCom by
attempt
add 27ce78f7cf7 fixup! Resolve live producers by region and read their
XCom by attempt
add fea24d4496a Pin loop definitions and carry region coordinates through
task execution
add 95da9fcbd1f fixup! Pin loop definitions and carry region coordinates
through task execution
add 09732a3b835 fixup! Pin loop definitions and carry region coordinates
through task execution
add ca944676eec fixup! Pin loop definitions and carry region coordinates
through task execution
add 793acce03e4 Give every mapped expansion a region and store its index
as region_index
add 2f5c3817772 fixup! Give every mapped expansion a region and store its
index as region_index
add ba7075e0efa fixup! Give every mapped expansion a region and store its
index as region_index
add c3bd46b2c9d Attribute log, asset-event and asset-state writes to the
task attempt
add f4d9d069208 fixup! Attribute log, asset-event and asset-state writes
to the task attempt
add 50d9f9ac352 fixup! Attribute log, asset-event and asset-state writes
to the task attempt
add 1f39e86def7 fixup! Attribute log, asset-event and asset-state writes
to the task attempt
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (70a0e6f55de)
\
N -- N -- N refs/heads/task-loops-stack-6 (1f39e86def7)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../administration-and-deployment/web-stack.rst | 13 +-
.../docs/authoring-and-scheduling/loops.rst | 6 +
airflow-core/docs/best-practices.rst | 52 ++++-
airflow-core/newsfragments/74499.bugfix.rst | 1 +
airflow-core/src/airflow/api_fastapi/app.py | 3 +-
.../src/airflow/api_fastapi/execution_api/app.py | 141 ++-----------
.../api_fastapi/execution_api/in_process.py | 148 ++++++++++++++
.../src/airflow/cli/commands/standalone_command.py | 31 +++
.../src/airflow/config_templates/config.yml | 9 +-
airflow-core/src/airflow/dag_processing/manager.py | 14 +-
.../src/airflow/dag_processing/processor.py | 8 -
.../src/airflow/executors/base_executor.py | 14 +-
.../src/airflow/jobs/scheduler_job_runner.py | 8 +-
.../src/airflow/jobs/triggerer_job_runner.py | 11 +-
.../unit/api_fastapi/execution_api/test_app.py | 45 +++++
.../api_fastapi/execution_api/test_in_process.py | 60 ++++++
airflow-core/tests/unit/api_fastapi/test_app.py | 2 +-
.../unit/cli/commands/test_standalone_command.py | 51 +++++
.../tests/unit/dag_processing/test_processor.py | 2 +-
.../tests/unit/executors/test_local_executor.py | 32 +++
airflow-core/tests/unit/jobs/test_scheduler_job.py | 40 +++-
airflow-e2e-tests/docker/go.yml | 7 +
.../tests/airflow_e2e_tests/conftest.py | 43 ++--
.../tests/airflow_e2e_tests/constants.py | 3 +
.../airflow_e2e_tests/e2e_test_utils/clients.py | 30 ++-
.../go_sdk_tests/test_go_sdk_native_dag.py | 220 +++++++++++++++++++++
go-sdk/example/native/main.go | 177 +++++++++++++++++
.../factory.go => example/native/report.go} | 20 +-
scripts/ci/prek/generate_execution_api_schema.py | 2 +
29 files changed, 993 insertions(+), 200 deletions(-)
create mode 100644 airflow-core/newsfragments/74499.bugfix.rst
create mode 100644
airflow-core/src/airflow/api_fastapi/execution_api/in_process.py
create mode 100644
airflow-core/tests/unit/api_fastapi/execution_api/test_in_process.py
create mode 100644
airflow-e2e-tests/tests/airflow_e2e_tests/go_sdk_tests/test_go_sdk_native_dag.py
create mode 100644 go-sdk/example/native/main.go
copy go-sdk/{cmd/airflow-go-pack/testdata/multidag/factory/factory.go =>
example/native/report.go} (69%)
