This is an automated email from the ASF dual-hosted git repository.
ashb pushed a change to branch task-loops-stack-10
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 7dbd1f3ccf7 fixup! Let the HITL review plugin address one loop pass or
mapped slot
omit 03e23ea139e Let the HITL review plugin address one loop pass or mapped
slot
omit d5f852b969f fixup! Read current task executions by exact region and try
omit e831b509185 fixup! Read current task executions by exact region and try
omit 3f9fa1256d9 Read current task executions by exact region and try
omit 86d77ca4c04 fixup! Clear selected loop work and regenerate only what
was replaced
omit b131857e836 fixup! Clear selected loop work and regenerate only what
was replaced
omit 52a5e88a35c Clear selected loop work and regenerate only what was
replaced
omit cde2024a71e fixup! Run loop gates and advance iterations atomically
omit 81ecf07286b fixup! Run loop gates and advance iterations atomically
omit 77be2be6f78 fixup! Run loop gates and advance iterations atomically
omit f633f8881f1 Run loop gates and advance iterations atomically
omit 70a0e6f55de fixup! Attribute log, asset-event and asset-state writes
to the task attempt
omit 1df025b0c9c fixup! Attribute log, asset-event and asset-state writes
to the task attempt
omit a0fccda4d0e fixup! Attribute log, asset-event and asset-state writes
to the task attempt
omit 17f78308155 Attribute log, asset-event and asset-state writes to the
task attempt
omit 31f60f70c3e fixup! Give every mapped expansion a region and store its
index as region_index
omit 09ba0d08b88 fixup! Give every mapped expansion a region and store its
index as region_index
omit 12e796ef66c Give every mapped expansion a region and store its index
as region_index
omit 2f7bed1b9f1 fixup! Pin loop definitions and carry region coordinates
through task execution
omit ac8660cc2c8 fixup! Pin loop definitions and carry region coordinates
through task execution
omit 8e97fc87016 fixup! Pin loop definitions and carry region coordinates
through task execution
omit 289fe5b3979 Pin loop definitions and carry region coordinates through
task execution
omit e650913f739 fixup! Resolve live producers by region and read their
XCom by attempt
omit c96fc80c47e Resolve live producers by region and read their XCom by
attempt
omit a6f0f2c6f7c fixup! Introduce the (internal/db level) concept of
"dynamic regions" for TIs
omit 28eacc4e201 Introduce the (internal/db level) concept of "dynamic
regions" for TIs
omit 338b4dba8d2 fixup! Add user-facing docs for the new Task Loops feature.
omit 1f7ad703b17 fixup! Add user-facing docs for the new Task Loops feature.
omit 1e4eaf25fac fixup! Add user-facing docs for the new Task Loops feature.
omit 2f47fd5be63 Add user-facing docs for the new Task Loops feature.
add 785d82da5c0 Cover native Go Dags in the go_sdk e2e test (#74411)
add dc38f84ff46 Consolidate in-process Execution API hosting (#73327)
add b8ef78f53ad Fix misleading timetable Variable example in best
practices (#73945)
add 1e404fac4ac Stop the scheduler crashing when a queued run's Dag fails
to deserialize (#74499)
add ea955744e4d Make airflow standalone discover new Dag files within
seconds (#74479)
add 0a913f21aa8 Use the configured API port in the default execution API
URL (#74478)
add 681faf7064f Add user-facing docs for the new Task Loops feature.
add c34fcb1e77d fixup! Add user-facing docs for the new Task Loops feature.
add d98b98ab8b5 fixup! Add user-facing docs for the new Task Loops feature.
add 0cd8de1c320 fixup! Add user-facing docs for the new Task Loops feature.
add 8591d22d6fe Introduce the (internal/db level) concept of "dynamic
regions" for TIs
add 205af7f2b4a fixup! Introduce the (internal/db level) concept of
"dynamic regions" for TIs
add 9eb157351cf Resolve live producers by region and read their XCom by
attempt
add 27ce78f7cf7 fixup! Resolve live producers by region and read their
XCom by attempt
add fea24d4496a Pin loop definitions and carry region coordinates through
task execution
add 95da9fcbd1f fixup! Pin loop definitions and carry region coordinates
through task execution
add 09732a3b835 fixup! Pin loop definitions and carry region coordinates
through task execution
add ca944676eec fixup! Pin loop definitions and carry region coordinates
through task execution
add 793acce03e4 Give every mapped expansion a region and store its index
as region_index
add 2f5c3817772 fixup! Give every mapped expansion a region and store its
index as region_index
add ba7075e0efa fixup! Give every mapped expansion a region and store its
index as region_index
add c3bd46b2c9d Attribute log, asset-event and asset-state writes to the
task attempt
add f4d9d069208 fixup! Attribute log, asset-event and asset-state writes
to the task attempt
add 50d9f9ac352 fixup! Attribute log, asset-event and asset-state writes
to the task attempt
add 1f39e86def7 fixup! Attribute log, asset-event and asset-state writes
to the task attempt
add 31f8fdc51b6 Run loop gates and advance iterations atomically
add 8819784ae6c fixup! Run loop gates and advance iterations atomically
add 97c009e58fb fixup! Run loop gates and advance iterations atomically
add 262afa3c671 fixup! Run loop gates and advance iterations atomically
add f7dc02db7bb Clear selected loop work and regenerate only what was
replaced
add 13b9af2ea16 fixup! Clear selected loop work and regenerate only what
was replaced
add 5f50da99229 fixup! Clear selected loop work and regenerate only what
was replaced
add ed8349519b3 Read current task executions by exact region and try
add 24a6355f08d fixup! Read current task executions by exact region and try
add da41c7897ec fixup! Read current task executions by exact region and try
add 0d4c3035aeb Let the HITL review plugin address one loop pass or mapped
slot
add 38fbc47c20d fixup! Let the HITL review plugin address one loop pass or
mapped slot
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (7dbd1f3ccf7)
\
N -- N -- N refs/heads/task-loops-stack-10 (38fbc47c20d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../administration-and-deployment/web-stack.rst | 13 +-
.../docs/authoring-and-scheduling/loops.rst | 6 +
airflow-core/docs/best-practices.rst | 52 ++++-
airflow-core/newsfragments/74499.bugfix.rst | 1 +
airflow-core/src/airflow/api_fastapi/app.py | 3 +-
.../src/airflow/api_fastapi/execution_api/app.py | 141 ++-----------
.../api_fastapi/execution_api/in_process.py | 148 ++++++++++++++
.../src/airflow/cli/commands/standalone_command.py | 31 +++
.../src/airflow/config_templates/config.yml | 9 +-
airflow-core/src/airflow/dag_processing/manager.py | 14 +-
.../src/airflow/dag_processing/processor.py | 8 -
.../src/airflow/executors/base_executor.py | 14 +-
.../src/airflow/jobs/scheduler_job_runner.py | 8 +-
.../src/airflow/jobs/triggerer_job_runner.py | 11 +-
.../unit/api_fastapi/execution_api/test_app.py | 45 +++++
.../api_fastapi/execution_api/test_in_process.py | 60 ++++++
airflow-core/tests/unit/api_fastapi/test_app.py | 2 +-
.../unit/cli/commands/test_standalone_command.py | 51 +++++
.../tests/unit/dag_processing/test_processor.py | 2 +-
.../tests/unit/executors/test_local_executor.py | 32 +++
airflow-core/tests/unit/jobs/test_scheduler_job.py | 40 +++-
airflow-e2e-tests/docker/go.yml | 7 +
.../tests/airflow_e2e_tests/conftest.py | 43 ++--
.../tests/airflow_e2e_tests/constants.py | 3 +
.../airflow_e2e_tests/e2e_test_utils/clients.py | 30 ++-
.../go_sdk_tests/test_go_sdk_native_dag.py | 220 +++++++++++++++++++++
go-sdk/example/native/main.go | 177 +++++++++++++++++
.../factory.go => example/native/report.go} | 20 +-
scripts/ci/prek/generate_execution_api_schema.py | 2 +
29 files changed, 993 insertions(+), 200 deletions(-)
create mode 100644 airflow-core/newsfragments/74499.bugfix.rst
create mode 100644
airflow-core/src/airflow/api_fastapi/execution_api/in_process.py
create mode 100644
airflow-core/tests/unit/api_fastapi/execution_api/test_in_process.py
create mode 100644
airflow-e2e-tests/tests/airflow_e2e_tests/go_sdk_tests/test_go_sdk_native_dag.py
create mode 100644 go-sdk/example/native/main.go
copy go-sdk/{cmd/airflow-go-pack/testdata/multidag/factory/factory.go =>
example/native/report.go} (69%)
