jason810496 opened a new pull request, #68709: URL: https://github.com/apache/airflow/pull/68709
**Need to wait until the following PRs merged** - https://github.com/apache/airflow/pull/68694 ## Why The Lang-SDK (Multi-Lang) feature is **executor-agnostic**, the best way to verify whether Lang-SDK is _executor-agnostic_ or not is adding k8s system test. We use CeleryExecutor for E2E test in docker-compose, the LocalExecutor is used for normal `breeze start-airflow` setup. ## How We haven't settle down the Artifact deployment for Lang-SDK (e.g. How does `*.jar`s and binaries being sync to worker). We intentionally defer this part to users to figure out the most comfortable way for them, then stabilize as best practice. The current k8s test add a small utility script (`stage_artifacts.py`) which leverages `S3DagBundle` in the `initContainer` section to provision the artifacts in the `pod` that KubernetesExecutor created. See more details in `kubernetes-tests/lang_sdk/README.md`. ## What Add k8s test for Lang-SDK feature that trigger a Dag with both Python, Java, and Go Tasks in it with KubernetesExecutor. --- ##### Was generative AI tooling used to co-author this PR? - [x] Yes, with help of Claude Code (Opus 4.8) following [the guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#gen-ai-assisted-contributions) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
