This is an automated email from the ASF dual-hosted git repository.
jason810496 pushed a change to branch jason/lang-sdk-e2e/08-native-e2e
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 36aee85a508 Exclude airflowignore_all from the license check
omit a6772aba6a4 Shorten the _ensure_executable docstring
omit 0204c2ecf57 Address review: chmod only the returned bundle, and
surface why one was skipped
omit ffc10ea4532 Discover executable bundles by footer, not by execute bit
omit bccf01269f5 Rework the lang-SDK k8s harness for mixed-language and
native Dag tests
omit e78500da2e0 Keep the k8s lang-SDK values comment within the YAML line
limit
omit 78f1e76f095 Read a native Dag example's served Dags with bundleDags
omit 93d59326e6c Say which coordinator runs the native e2e Java tasks
omit 65c3da24a2d Drop the dag_bundle_name reason from the k8s native
TypeScript skip
omit 49b905f6a94 Parse native Dags in the e2e by class, not by Dag bundle
name
omit f8c09c9850b Name the skipped-branch e2e test after what it checks
omit 6e6dd63f7ed Document how the TypeScript example's native Dag gets
parsed
omit d0a8c315fdb Explain why the k8s native TypeScript Dag test is skipped
omit baeb27354c1 Pack the TypeScript example against the built SDK
omit b0482d2f459 Build the TypeScript SDK before packing the k8s example
bundle
omit 022fa493fc5 Key the Lang-SDK e2e jobs on native Dag modules only
omit 13cdecd622d Build the k8s TypeScript artifacts only for the native Dag
test
omit b8b62b3f095 Share the Dag run lookup and the native Java queue name
omit c5e8e4629c0 Run the Lang-SDK e2e jobs when native Dag parsing changes
omit 242a4aeaf14 Add a native Java Dag to the compose e2e
omit 32a2f578da0 Keep the containerized Java build's Maven repository on
the host
omit 91419a9354d Check the native TypeScript Dag's source and triggered run
omit 07b996c2878 Parse the native TypeScript Dag in the compose e2e
omit 57b3bdfcfbe TS SDK: cover native TypeScript Dags end to end
omit e87621078ba Java SDK: Pack each native Dag's source file into the
bundle JAR
omit 10d8f689db6 Java SDK: Record the class that declares each Dag and
describe it on request
omit 4e24713ecfa Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
omit 6ef5cf3ca07 Java SDK: Declare a Dag's task graph with @Builder.Deps
omit 698fae9d4e1 TS SDK: add triggerDagRun to the native Dag surface
omit b4a8b236277 TS SDK: add multi-way branching with dag.switch
omit 1e2ed16c033 TS SDK: add conditional branching with dag.if
omit 1e09e5fdfbe Say tasks list runs a native TypeScript Dag's bundle
omit 02f1e5169c0 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
omit 2b606617e9a Run a native TypeScript Dag's own bundle through the
native task branch
omit 158894e8564 Let the Node Dag importer find its coordinator
omit 881795f9d20 Hand out the Node Dag importer through get_dag_importer
omit aac11e6a559 Pin the Code view to the entry module in Node bundle tests
omit fce03d56bcc Let NodeDagImporter source read errors reach the caller
omit 861ffd6e9ef Import NodeDagImporter at the top of the Node coordinator
omit 58cf8d1a3e6 Warn against defining a Dag in both TypeScript and Python
omit 2485d7c38c3 Align the TypeScript build docs with the Code view
omit 7be05790dd6 Say when the Dag processor needs Node.js for TypeScript
bundles
omit db26372198b Run a native TypeScript Dag's task from its own bundle
omit 761ce1ab1af Share the bundle section mutation helper between Node tests
omit d1821478b82 Document parsing native TypeScript Dags
omit 12307d82ea3 Parse native TypeScript Dags with the Node coordinator
add 37759fb9c26 Put the JAR a Dag was parsed from first on its classpath
add 9f08bce28d2 Keep a JAR whose manifest cannot be read, not only for
OSError and BadZipFile
add 8ecee9ec935 Let the first executable JAR's Main-Class win, not the
last one found
add bce7efc0478 Say the native Java ignore bullet applies with one
coordinator too
add 87236e5c5e6 Assert execute_task never asks for the parsing coordinator
add 705c315b7a7 Autospec the bundles this test class mocks
add d243b2bfcb0 Move a deferred secrets_masker import to the top of the
module
add cab56f42a9e Show both .airflowignore cases and syntaxes for the
task-handler JAR
add 9addf2f20ba Parse native TypeScript Dags with the Node coordinator
add 4b88cfa0481 Document parsing native TypeScript Dags
add 47ba6da22b4 Share the bundle section mutation helper between Node tests
add ba5b8cc06a6 Run a native TypeScript Dag's task from its own bundle
add 3497a0ccd1c Say when the Dag processor needs Node.js for TypeScript
bundles
add b940fd7c3cc Align the TypeScript build docs with the Code view
add 62ab930e65e Warn against defining a Dag in both TypeScript and Python
add 102546d73bf Import NodeDagImporter at the top of the Node coordinator
add 348e95bf675 Let NodeDagImporter source read errors reach the caller
add 7a78614b099 Pin the Code view to the entry module in Node bundle tests
add 38b7748b3a4 Hand out the Node Dag importer through get_dag_importer
add 917caaad9e5 Let the Node Dag importer find its coordinator
add b38787ed046 Run a native TypeScript Dag's own bundle through the
native task branch
add 443941ac9c4 Document how a NodeCoordinator is picked for parsing
TypeScript Dags
add 7dbaafe8c52 Say tasks list runs a native TypeScript Dag's bundle
add 4663a325ec2 Show each native Dag's own source in the Code tab (#74249)
add 0cfef3fddf5 TS SDK: add conditional branching with dag.if
add 72ec6b106fe TS SDK: add multi-way branching with dag.switch
add c6574595604 TS SDK: add triggerDagRun to the native Dag surface
add 2e40afcdef9 Java SDK: Declare a Dag's task graph with @Builder.Deps
add 1c3a74c5c47 Java SDK: Serialize native Dags to DagSerialization v3 on
parse requests
add 406263c475b Java SDK: Record the class that declares each Dag and
describe it on request
add 5d91e38934c Java SDK: Pack each native Dag's source file into the
bundle JAR
add df620a23da5 TS SDK: cover native TypeScript Dags end to end
add 75c8d88360e Parse the native TypeScript Dag in the compose e2e
add 2c92a514f9c Check the native TypeScript Dag's source and triggered run
add 44ac3a75bcd Keep the containerized Java build's Maven repository on
the host
add ca0451d3bab Add a native Java Dag to the compose e2e
add 69696aa216c Run the Lang-SDK e2e jobs when native Dag parsing changes
add b5c0d3fe3ee Share the Dag run lookup and the native Java queue name
add ddfb7d95fb3 Build the k8s TypeScript artifacts only for the native Dag
test
add 073236e5b48 Key the Lang-SDK e2e jobs on native Dag modules only
add b39107bda9d Build the TypeScript SDK before packing the k8s example
bundle
add 7896f9a08a3 Pack the TypeScript example against the built SDK
add a357f8382ee Explain why the k8s native TypeScript Dag test is skipped
add c355d5c15be Document how the TypeScript example's native Dag gets
parsed
add 0b24339a02e Name the skipped-branch e2e test after what it checks
add a7f48edfa79 Parse native Dags in the e2e by class, not by Dag bundle
name
add 4c4e43b6158 Drop the dag_bundle_name reason from the k8s native
TypeScript skip
add 91195107e3e Say which coordinator runs the native e2e Java tasks
add 3c9b59fc98a Read a native Dag example's served Dags with bundleDags
add 0e3e03f4e51 Keep the k8s lang-SDK values comment within the YAML line
limit
add 70b2aabf826 Rework the lang-SDK k8s harness for mixed-language and
native Dag tests
add 24de72d388f Discover executable bundles by footer, not by execute bit
add bce911355fd Address review: chmod only the returned bundle, and
surface why one was skipped
add b3c802f1648 Shorten the _ensure_executable docstring
add 8b1b9923110 Exclude airflowignore_all from the license check
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (36aee85a508)
\
N -- N -- N refs/heads/jason/lang-sdk-e2e/08-native-e2e
(8b1b9923110)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../language-sdks/java.rst | 29 ++++++++++++++---
.../src/airflow/dag_processing/collection.py | 4 +--
airflow-core/src/airflow/dag_processing/dagbag.py | 10 ++++--
.../airflow/dag_processing/lang_sdk_processor.py | 22 ++++++++++---
.../src/airflow/dag_processing/processor.py | 2 +-
.../tests/unit/dag_processing/fake_lang_sdk.py | 2 +-
.../tests/unit/dag_processing/test_collection.py | 2 +-
.../tests/unit/dag_processing/test_dagbag.py | 19 +++++-------
.../unit/dag_processing/test_lang_sdk_processor.py | 21 ++++++++++++-
.../tests/unit/dag_processing/test_manager.py | 2 +-
.../tests/unit/dag_processing/test_processor.py | 4 +--
.../airflow/sdk/coordinators/java/_dag_importer.py | 4 +--
.../airflow/sdk/coordinators/java/coordinator.py | 33 +++++++++++++++-----
.../airflow/sdk/coordinators/node/_dag_importer.py | 16 ++++++++--
task-sdk/src/airflow/sdk/importers/base.py | 9 ++++--
.../src/airflow/sdk/importers/python_importer.py | 4 +--
task-sdk/src/airflow/sdk/importers/zip_importer.py | 4 +--
.../task_sdk/coordinators/java/test_coordinator.py | 35 +++++++++++++++++++++
.../coordinators/java/test_dag_importer.py | 11 +++++++
.../coordinators/node/test_dag_importer.py | 34 +++++++++++++++++++-
.../task_sdk/coordinators/test_dag_importer.py | 2 +-
.../tests/task_sdk/coordinators/test_subprocess.py | 36 +++++++++-------------
.../task_sdk/execution_time/test_supervisor.py | 3 +-
23 files changed, 229 insertions(+), 79 deletions(-)
