nzw921rx opened a new pull request, #12458: URL: https://github.com/apache/seatunnel/pull/12458
## Purpose SeaTunnel can submit jobs to a long-running Zeta cluster, but it cannot create an isolated native Zeta application on YARN or Kubernetes. Users currently need custom scripts to provision the Master and Workers, configure discovery, submit the job, propagate failures, and clean up resources. This change adds an experimental native Application Mode. One submission creates one platform application with one Zeta Master, a configurable fixed number of Workers, and one job. It supports platform-native status and cancellation, multi-Worker execution, standard distribution integration, and explicit recovery in a new application from a durable checkpoint. Related proposal: apache/seatunnel#12457 ## Main changes - Add an always-built `seatunnel-resource-manager-core` module with platform-neutral deployment contracts, configuration, and localized JAR path resolution. - Add optional `yarn` and `kubernetes` provider modules behind independent Maven profiles. - Add a Zeta server `ResourceManagerDriver` SPI for external Worker allocation while retaining the existing slot scheduler. - Add the application CLI/runtime, standard distribution packaging, provider isolation, and YARN/Kubernetes configuration templates. - Add one package-separated resource-manager E2E module with shared FakeSource, Console, and Assert jobs. - Add HDFS and persistent-volume checkpoint recovery coverage across separate platform applications. - Add complete English and Chinese Application Mode guides for YARN and Kubernetes. - Add focused GitHub Actions jobs for both providers, with diagnostics uploaded only on failure. The first phase uses one Master and a fixed Worker count. Multiple Masters, automatic Worker replacement, autoscaling, and Kerberos are outside this phase. ## Validation - 48-module dependency build and packaging: passed. - Focused Engine Core and resource-manager Core tests: 41 passed. - Starter, YARN provider, and Kubernetes provider tests: 42 passed. - Kubernetes Application Mode E2E: 6 passed. - YARN Application Mode E2E: 6 passed, including HDFS checkpoint recovery in a new application. - `git diff --check`, workflow YAML parsing, and changed-document link checks: passed. Maven `verify` was not run because the repository task instructions prohibit invoking that goal. Equivalent package, test, and integration-test phases were run directly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
