jerryshao opened a new issue, #13616: URL: https://github.com/apache/gravitino/issues/13616
### Describe the subtask The `k8s` job executor added in #13613 lives in its own module, and Gravitino can't use it yet. Built-in Spark jobs can't run on it either: the executable of a built-in template is the path of the jobs jar on the Gravitino server, and a Spark driver on Kubernetes can't reach that path. - Register `k8s` in `JobExecutorFactory.BUILTIN_EXECUTORS` by class name, so that `core` doesn't depend on the plugin module. - Copy the shaded jar of the executor into `libs` of the distribution package. - Add a smoke test that loads the shaded jar with the Gravitino server's classpath, to catch dependency conflicts. - Add `spark.builtinJobsJar`: the URI of the jobs jar that the Spark driver can reach. It defaults to `local:///opt/gravitino/jobs/gravitino-jobs.jar`, the path of the jar in the `gravitino-spark` image. - At submission, replace the executable of a template whose name starts with `builtin-` with that URI. The stored templates don't change, and the local executor keeps using the jar on the server. ### Parent issue #13554 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
