This is an automated email from the ASF dual-hosted git repository.
jason810496 pushed a change to branch
jason/core-taskhandler-refactor/11-candidate-listing-fast-path
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 4392e00c1fa Describe the per-candidate fast path in ADR-0013
omit aa69e75c126 Decide per candidate whether a parse must probe it
omit 58a284a8440 Read a TS bundle's cache digest from its layout line
omit 3c8e5ec0c92 List Java task handler JARs by their cache digest
omit 7e54a9fb507 List Go task handler bundles by their trailer
omit 63292fe3e4e Let a coordinator list the artifacts it can probe
omit 568fa9f6293 Align the artifact sweep with the other cleanup checks
omit 23fbabd6e9c Warn only about bindings of Dags missing from the parse
result
omit 6776b7ee22c Give the task handler race tests their own sessions
omit e4260cb1099 Describe the binding reconcile and artifact sweep in
ADR-0013
omit b26d39c7ff5 Delete task handler artifacts no stub task references
omit 0891a5cb562 Index task handler artifacts by last_probed_at
omit 80139bfb9ec Record probed artifacts and reconcile task handler bindings
omit 0d5b0cc5d02 Sync the Java SDK supervisor schema for task handler
bindings
omit 1aea61dee76 Regenerate TS SDK supervisor types for task handler
bindings
omit e889746ff2c Carry task handler bindings and probed answers on the
parse result
omit a19f24fefc1 Test that a Dag file gets only named bundles without a
fallback
omit 9f37dfabacc Describe how known artifacts are scoped per Dag-parsing
child
omit 92b5f860514 Send the Dag-parsing child its known task-handler artifacts
omit f3ef2375eed Sync the Java SDK supervisor schema for known artifacts
omit c530aaa0f5d Regenerate TS SDK supervisor types for known artifacts
omit c2ec11e9be8 Add known task-handler artifacts to the Dag parse request
omit 63d28dfdc66 Let the coordinator registry list its task-handler bundles
omit 03405f9b3e3 Java SDK: answer a task handler parse with every handler
omit b55944b8182 Test the cache digest of classpath directories and non-zip
files
omit da11ffc9285 Tidy names and mocks in the Java probe test
omit c7fe9d0b1f9 Test the Java SDK schema sync hook's snapshot copy
omit 1804b24ccf2 Say why the Java coordinator rejects a JAR it cannot probe
omit c57160aca84 Java SDK: check the task handler reply against the
supervisor schema
omit d9b4faf50c9 Java SDK: list a value schema's enum constants in a stable
order
omit 62006b90089 Let the Java coordinator probe a JAR's task handlers
omit 90da59317fa Java SDK: register stub Dags' Java tasks as task handlers
omit 6da54887166 Java SDK: stamp a cache digest on the bundle JAR manifest
omit 6a335956646 Java SDK: answer TaskHandlerParseRequest with registered
handlers
omit fc8d87a76aa Java SDK: record handler parameters in generated task
classes
omit fa3d7051ced Java SDK: sync the vendored supervisor schema from the
monorepo
omit 3d1332e644b TS SDK: answer a task handler parse with every handler
omit 895c5d9d250 Patch the TS real probe test with decorators
omit bed59a8db61 Skip the TS real probe when node cannot report a version
omit bce1697092f TS SDK: name the task handler lookup like its siblings
omit 989055e7a98 Let the Node coordinator probe a bundle's task handlers
omit 5c0b389a228 TS SDK: answer TaskHandlerParseRequest from bundle.serve
omit 421cb2314a9 State that a task handler parse answer depends only on the
artifact
omit 9ac136b7122 Go SDK: answer a task handler parse with every handler
omit 2367d83c173 Tidy names, mocks and cases in the Go probe and digest
tests
omit 583e9997819 Move Go SDK comments back to the code they describe
omit 5c994cda4a0 Resolve the probed bundle path and tighten the digest docs
omit d8613040957 Go SDK: take the bundle digests from the staged executable
omit c437221182e Document the task handler parse for Language SDK authors
omit f42aa98608c Read a Go bundle's stored cache digest without hashing it
omit aa05229820e Let the Executable coordinator probe a bundle's task
handlers
omit a859350b5d6 Go SDK: record integrity and cache digests in bundle
metadata
omit 1250abbcd98 Go SDK: regenerate genmodels for the named_open binding
omit 46c30b41923 Go SDK: clarify parse timeout and nested-null docs, test
anyOf
omit e6307f893f6 Go SDK: answer TaskHandlerParseRequest with registered
handlers
omit 052cb8e3dd1 Go SDK: describe task handler params with JSON Schema
omit 32941deefd2 Go SDK: regenerate genmodels from the supervisor schema
omit 0b77a65e354 Probe a task handler artifact without naming Dags
omit 12301131f0a Close the fake runtime's sockets when its reply is done
omit acba2e5ca6a Name the runtime transport test helpers with verbs
omit e04b994ae7c Patch with decorators in the runtime transport tests
omit 274b750192c Hang the fake runtimes without sleeping
omit 86b6a606d85 Test that a start failing before the fork closes its
listeners
omit cb8e7b92e57 Spec the mocks in the runtime transport and probe tests
omit 173ac921a5d Import ctypes at the top of the subprocess coordinator
module
omit 8323e15e104 Pass the binding mode in the task-handler probe tests
omit 45580954214 Tidy the runtime transport and the coordinator lookup
omit d43b88f1a1a Clean up a Lang-SDK runtime parse whose start fails after
the fork
omit de45ceba937 Do not exec a Lang-SDK runtime whose parent has already
exited
omit 8c7e2888e59 Kill what a Lang-SDK runtime leaves behind when it exits
omit b4b98407ce5 Read a Lang-SDK runtime's frames without blocking the
parse loop
omit 6a77bfb1bd9 Probe a Lang-SDK artifact for its task handlers
omit 6da772bd023 Keep a nested supervised child's standard streams open
omit b98c1882b65 Make the Dag file processor base generic over its result
omit 0e65496cbc6 Let a subprocess coordinator exec a task-handler parse
runtime
omit 020bdcc03ca Describe the all-handlers probe in ADR-0011 and ADR-0012
omit 68e0cdddd0d Regenerate TS SDK supervisor types for the probe without
dag_ids
omit 84460f71c1f Ask a task handler runtime for every handler it registers
omit b1b645435cd Add the named_open binding to the Lang-SDK ADRs
omit 267cc098be0 Regenerate TS SDK supervisor types for the named_open
binding
omit 48c7217ec34 Add a named_open binding for non-exhaustive task-handler
params
omit 5b2d32caa7a Describe the binding-mode parse check in ADR-0011 and
ADR-0013
omit e37df9a8e18 Describe the task-handler binding mode in ADR-0012
omit b6137fe719e Regenerate TS SDK supervisor types for the binding mode
omit ffbd6892edb Add a binding mode to task-handler declarations
omit c08b607a132 Document the version rules for a new supervisor schema body
omit 4e462352188 Regenerate TS SDK supervisor types for task-handler
messages
omit afcd4e6eb31 Add task-handler parse messages and their parse-channel
union
omit e9b1ba3f249 Test closing a Dag file processor that has no parse log
file
omit d301fee5d6c Move the Dag file processor's shared plumbing into a base
class
omit 0cafad2a563 Allow a NULL cache digest in ADR-0013's artifact table SQL
omit ad99d4bb954 Let a task handler artifact store no cache digest
omit a25eb7bbae6 Move the handler declarations to the artifact in
ADR-0013's SQL
omit 190ebe44ac9 Cache an artifact's task handlers on its row, not on each
binding
omit 98e861e65cc Make session keyword-only in the task handler model test
helpers
omit 789b3350332 Add handler_binding to ADR-0013's task handler table SQL
omit 3cfef080de0 Store the task handler binding mode beside its params
omit b3af3a2f47b Regenerate the task handler migration revision id
omit 9f3aeca70b1 Describe LangSDKTaskHandler as a stub task binding
omit b59afdd8832 Test that a referenced task handler artifact cannot be
deleted
omit 0e23840eb98 Keep the artifact path hash in sync on ORM updates
omit 964db377738 Match ADR-0013 task handler table SQL to the migration
omit 1acc9b64013 Add lang-SDK task handler binding tables
add 7d1d54f8df1 Say the Dag processor needs the language SDK setup too
add 37beb8ec4f5 Add lang-SDK task handler binding tables
add 4da20330927 Match ADR-0013 task handler table SQL to the migration
add 73715f836fd Keep the artifact path hash in sync on ORM updates
add 1c782678224 Test that a referenced task handler artifact cannot be
deleted
add 34595f1e611 Describe LangSDKTaskHandler as a stub task binding
add 88a952d6923 Regenerate the task handler migration revision id
add faa8558073b Store the task handler binding mode beside its params
add 860dad5b421 Add handler_binding to ADR-0013's task handler table SQL
add 96789418983 Make session keyword-only in the task handler model test
helpers
add 6d194fdee7d Cache an artifact's task handlers on its row, not on each
binding
add 45e7b7b351b Move the handler declarations to the artifact in
ADR-0013's SQL
add 45a0221d614 Let a task handler artifact store no cache digest
add 9bb714bdf05 Allow a NULL cache digest in ADR-0013's artifact table SQL
add ca2c7c99499 Move the Dag file processor's shared plumbing into a base
class
add 59a5bc27503 Test closing a Dag file processor that has no parse log
file
add bd591739323 Add task-handler parse messages and their parse-channel
union
add 6787551b0ff Regenerate TS SDK supervisor types for task-handler
messages
add 2d63e560647 Document the version rules for a new supervisor schema body
add 22b1ecde5ed Add a binding mode to task-handler declarations
add 44b9e8a330c Regenerate TS SDK supervisor types for the binding mode
add 0c5783121c4 Describe the task-handler binding mode in ADR-0012
add 00fb770fe2d Describe the binding-mode parse check in ADR-0011 and
ADR-0013
add b3daf463995 Add a named_open binding for non-exhaustive task-handler
params
add cf24a55709f Regenerate TS SDK supervisor types for the named_open
binding
add 51b4d1ae876 Add the named_open binding to the Lang-SDK ADRs
add c4346b16be0 Ask a task handler runtime for every handler it registers
add 561cc63ae9c Regenerate TS SDK supervisor types for the probe without
dag_ids
add b88bd4f5fe9 Describe the all-handlers probe in ADR-0011 and ADR-0012
add f5e6690653e Let a subprocess coordinator exec a task-handler parse
runtime
add 3a114b15c0c Make the Dag file processor base generic over its result
add 0f5792c18e4 Keep a nested supervised child's standard streams open
add a43ef8a4751 Probe a Lang-SDK artifact for its task handlers
add beeaafc8745 Read a Lang-SDK runtime's frames without blocking the
parse loop
add e41925c8a03 Kill what a Lang-SDK runtime leaves behind when it exits
add 9c95909cd18 Do not exec a Lang-SDK runtime whose parent has already
exited
add 775c0dd16f9 Clean up a Lang-SDK runtime parse whose start fails after
the fork
add f2100f22358 Tidy the runtime transport and the coordinator lookup
add 34ef146bcf9 Pass the binding mode in the task-handler probe tests
add 70357892782 Import ctypes at the top of the subprocess coordinator
module
add 6360ff7f697 Spec the mocks in the runtime transport and probe tests
add 59e16139df4 Test that a start failing before the fork closes its
listeners
add 54ff4e1f46b Hang the fake runtimes without sleeping
add 59011fc543f Patch with decorators in the runtime transport tests
add ba5d137a275 Name the runtime transport test helpers with verbs
add 645a024a749 Close the fake runtime's sockets when its reply is done
add f6918d8ecdc Probe a task handler artifact without naming Dags
add 0d0c1a66281 Go SDK: regenerate genmodels from the supervisor schema
add 6da5481daec Go SDK: describe task handler params with JSON Schema
add 47741c863b2 Go SDK: answer TaskHandlerParseRequest with registered
handlers
add 90eb57225a3 Go SDK: clarify parse timeout and nested-null docs, test
anyOf
add a5c07046389 Go SDK: regenerate genmodels for the named_open binding
add 0ab82445ec9 Go SDK: record integrity and cache digests in bundle
metadata
add 7b809900183 Let the Executable coordinator probe a bundle's task
handlers
add 84d7d5116f1 Read a Go bundle's stored cache digest without hashing it
add b69ecca8f6d Document the task handler parse for Language SDK authors
add e939ac6fe39 Go SDK: take the bundle digests from the staged executable
add 91307f3fa75 Resolve the probed bundle path and tighten the digest docs
add d6f462f00fa Move Go SDK comments back to the code they describe
add acf207ebde4 Tidy names, mocks and cases in the Go probe and digest
tests
add fb64343c9d8 Go SDK: answer a task handler parse with every handler
add 78995cf2159 State that a task handler parse answer depends only on the
artifact
add 6919d5453eb TS SDK: answer TaskHandlerParseRequest from bundle.serve
add ec70c20c020 Let the Node coordinator probe a bundle's task handlers
add 0132669e25a TS SDK: name the task handler lookup like its siblings
add a0841101fe0 Skip the TS real probe when node cannot report a version
add 4648117e0b5 Patch the TS real probe test with decorators
add dc5a0827e4d TS SDK: answer a task handler parse with every handler
add 0b6da6a1d46 Java SDK: sync the vendored supervisor schema from the
monorepo
add 4af2bac88f1 Java SDK: record handler parameters in generated task
classes
add 4594bce8dc5 Java SDK: answer TaskHandlerParseRequest with registered
handlers
add be00f52d2f3 Java SDK: stamp a cache digest on the bundle JAR manifest
add fcac3a4d03b Java SDK: register stub Dags' Java tasks as task handlers
add 7102e9a262b Let the Java coordinator probe a JAR's task handlers
add 20b9e55e91e Java SDK: list a value schema's enum constants in a stable
order
add cb039b71030 Java SDK: check the task handler reply against the
supervisor schema
add 0cdc9b70e53 Say why the Java coordinator rejects a JAR it cannot probe
add 29628e38a1a Test the Java SDK schema sync hook's snapshot copy
add a9aef326691 Tidy names and mocks in the Java probe test
add fc8f15cf343 Test the cache digest of classpath directories and non-zip
files
add b6456cd2002 Java SDK: answer a task handler parse with every handler
add 251d7b390bd Let the coordinator registry list its task-handler bundles
add 0980cd55475 Add known task-handler artifacts to the Dag parse request
add 2d039448a3c Regenerate TS SDK supervisor types for known artifacts
add 60a79123e8b Sync the Java SDK supervisor schema for known artifacts
add 200108188ce Send the Dag-parsing child its known task-handler artifacts
add 861140b3d65 Describe how known artifacts are scoped per Dag-parsing
child
add 34aabf6b8ef Test that a Dag file gets only named bundles without a
fallback
add 19ec1cd3778 Carry task handler bindings and probed answers on the
parse result
add 9e567d8f017 Regenerate TS SDK supervisor types for task handler
bindings
add d841ada39dd Sync the Java SDK supervisor schema for task handler
bindings
add d3fb42dc3e5 Record probed artifacts and reconcile task handler bindings
add 4a7fa62ad70 Index task handler artifacts by last_probed_at
add e828af9d1e0 Delete task handler artifacts no stub task references
add 1a6b94f82af Describe the binding reconcile and artifact sweep in
ADR-0013
add d160b8effa4 Give the task handler race tests their own sessions
add 41cbf34f7b2 Warn only about bindings of Dags missing from the parse
result
add fead9511c86 Align the artifact sweep with the other cleanup checks
add 2ceb4d43f50 Let a coordinator list the artifacts it can probe
add 480ada33266 List Go task handler bundles by their trailer
add db6f38cf653 List Java task handler JARs by their cache digest
add c5fc61b5627 Read a TS bundle's cache digest from its layout line
add e7a3d13e5e0 Decide per candidate whether a parse must probe it
add efd9eb04c2f Describe the per-candidate fast path in ADR-0013
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (4392e00c1fa)
\
N -- N -- N
refs/heads/jason/core-taskhandler-refactor/11-candidate-listing-fast-path
(efd9eb04c2f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../authoring-and-scheduling/language-sdks/go.rst | 32 ++++++++++++---------
.../language-sdks/index.rst | 6 ++--
.../language-sdks/java.rst | 33 +++++++++++++---------
.../language-sdks/typescript.rst | 29 ++++++++++---------
.../src/airflow/config_templates/config.yml | 15 +++++++---
go-sdk/README.md | 23 ++++++++-------
java-sdk/README.md | 11 ++++++--
ts-sdk/README.md | 8 +++++-
8 files changed, 96 insertions(+), 61 deletions(-)
