This is an automated email from the ASF dual-hosted git repository.
ephraimbuddy pushed a change to branch dag-processor-work-delivery
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 44a73caff8c Adapt legacy Dag upgrade regression to bundle discovery
results
discard 1f1e11878d2 Align Dag processor claim migrations with main
discard 82c3a97156b Test legacy Dag deactivation after bundle-name backfill
discard c4b2eced2b3 Fix Dag processor work retries and metadata cleanup
discard f5a3d0d90d7 Retain Dag processor work until delivery is acknowledged
discard d070c9eb9b9 Align API-mode Dag publication with DB-mode cleanup
discard a849e989ab8 Allow Dag processors to publish metadata through the
Execution API
discard 9bf2500e269 Keep Dag parsing responsive during bundle refresh failures
discard d389070a6e5 Make the bundle refresh regression test independent of
uptime
discard 1aac6aff89c Avoid parsing stalls while a bundle refresh waits for
imports
discard 40ade230912 Keep Dag parsing results aligned with refreshed bundle
sources
add 52237589d0f Java SDK: register the Scala Spark example as task
handlers (#75444)
add ccbd215ff29 TypeScript SDK: take the task state store retention in
seconds (#75445)
add 09fafbcec98 Fix upgrade guide sections showing as separate pages in
the docs sidebar (#75468)
add 763cb20ddc1 Fix SageMaker credential failures being reported as
timeouts (#74867)
add e71a6fb4790 Disable branch protection on v3-4-stable (#75473)
add d977d20aae3 Bump sphinx-airflow-theme to 0.3.15 for a more readable
docs sidebar (#75471)
add 1a50a18a3c6 Go SDK: fail a task whose return-value XCom push fails
(#75443)
add 06130cdc7fe Re-enable branch protection on v3-4-stable (#75477)
add b7dfaf64261 Fix docs pages listing their sections as separate pages in
the sidebar (#75478)
add 719a685079c Add consolidated Language SDK compatibility matrix (#71757)
add 910f8408714 Keep Dag parsing results aligned with refreshed bundle
sources
add 77e805b0a98 Avoid parsing stalls while a bundle refresh waits for
imports
add 321d83ff277 Make the bundle refresh regression test independent of
uptime
add 8ad19caf8c4 Keep Dag parsing responsive during bundle refresh failures
add 711853c7036 Keep Git bundles importable on Airflow 3.4
add 49ece412170 Clarify bundle refresh compatibility and simplify its
regression test
add 0cd75a5b597 Allow Dag processors to publish metadata through the
Execution API
add 1f597e034e4 Align API-mode Dag publication with DB-mode cleanup
add 886f1d3f6f6 Retain Dag processor work until delivery is acknowledged
add 90cc0060169 Fix Dag processor work retries and metadata cleanup
add 77c0ace9616 Test legacy Dag deactivation after bundle-name backfill
add 4a469dc9c35 Align Dag processor claim migrations with main
add 1aaeeb66faa Adapt legacy Dag upgrade regression to bundle discovery
results
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (44a73caff8c)
\
N -- N -- N refs/heads/dag-processor-work-delivery (1aaeeb66faa)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.pre-commit-config.yaml | 15 +
.../administration-and-deployment/dag-bundles.rst | 12 +-
.../dagfile-processing.rst | 12 +-
.../logging-monitoring/metrics.rst | 2 +-
.../authoring-and-scheduling/language-sdks/go.rst | 9 +-
.../language-sdks/index.rst | 251 ++++++++++++++++
.../language-sdks/typescript.rst | 25 +-
airflow-core/docs/core-concepts/debug.rst | 2 +-
.../docs/howto/create-custom-decorator.rst | 2 +-
airflow-core/docs/howto/custom-view-plugin.rst | 22 +-
airflow-core/docs/howto/customize-ui.rst | 12 +-
airflow-core/docs/howto/notifications.rst | 2 +-
airflow-core/docs/howto/set-config.rst | 2 +-
.../docs/installation/upgrading_to_airflow3.rst | 6 +-
.../tests/unit/dag_processing/test_manager.py | 2 +-
contributing-docs/30_new_language_sdk.rst | 171 ++++++++---
devel-common/pyproject.toml | 2 +-
go-sdk/README.md | 96 +++---
go-sdk/capabilities.yaml | 153 +++++++---
go-sdk/internal/bundle/task.go | 58 ++--
go-sdk/internal/bundle/task_test.go | 116 ++++++--
java-sdk/README.md | 96 +++---
java-sdk/capabilities.yaml | 153 +++++++---
.../apache/airflow/example/ScalaSparkExample.scala | 33 +--
java-sdk/sdk/module.md | 96 +++---
.../providers/amazon/aws/triggers/sagemaker.py | 9 +-
.../unit/amazon/aws/triggers/test_sagemaker.py | 65 +++-
.../git/src/airflow/providers/git/bundles/git.py | 11 +-
.../src/airflow/providers/git/version_compat.py | 3 +-
providers/git/tests/unit/git/bundles/test_git.py | 56 +++-
scripts/ci/prek/lang_sdk_compat_matrix.py | 326 +++++++++++++-------
scripts/ci/prek/update_go_sdk_readme_matrix.py | 6 +-
scripts/ci/prek/update_java_sdk_readme_matrix.py | 6 +-
scripts/ci/prek/update_lang_sdk_central_matrix.py | 152 ++++++++++
scripts/ci/prek/update_ts_sdk_readme_matrix.py | 6 +-
scripts/tests/ci/prek/conftest.py | 55 ++++
.../tests/ci/prek/test_lang_sdk_compat_matrix.py | 330 ++++++++++++++-------
.../ci/prek/test_update_go_sdk_readme_matrix.py | 25 +-
.../ci/prek/test_update_java_sdk_readme_matrix.py | 27 +-
.../ci/prek/test_update_lang_sdk_central_matrix.py | 148 +++++++++
.../ci/prek/test_update_ts_sdk_readme_matrix.py | 27 +-
.../observability/metrics/metrics_registry.py | 6 +-
ts-sdk/README.md | 96 +++---
ts-sdk/capabilities.yaml | 172 ++++++++---
ts-sdk/example/src/main.ts | 2 +-
ts-sdk/src/coordinator/client.ts | 32 +-
ts-sdk/src/coordinator/operator-runner.ts | 4 +-
ts-sdk/src/hitl/operator.ts | 2 +-
ts-sdk/src/sdk/client-types.ts | 10 +-
ts-sdk/src/sdk/client.ts | 6 +-
ts-sdk/src/sdk/operator.ts | 8 +-
ts-sdk/tests/coordinator/client.test.ts | 28 +-
ts-sdk/tests/coordinator/operator-runner.test.ts | 8 +-
ts-sdk/tests/public-api.test.ts | 2 +-
uv.lock | 8 +-
55 files changed, 2205 insertions(+), 781 deletions(-)
create mode 100755 scripts/ci/prek/update_lang_sdk_central_matrix.py
create mode 100644 scripts/tests/ci/prek/test_update_lang_sdk_central_matrix.py
