Anirudh Ramanathan created SPARK-22646:
------------------------------------------
Summary: Spark on Kubernetes - basic submission client
Key: SPARK-22646
URL: https://issues.apache.org/jira/browse/SPARK-22646
Project: Spark
Issue Type: Sub-task
Components: Scheduler
Affects Versions: 2.3.0
Reporter: Anirudh Ramanathan
The submission client is mainly responsible for creating the Kubernetes pod
that runs the Spark driver. It follows a step-based approach to construct the
driver pod, as the code under the submit.steps package shows. The steps are
orchestrated by DriverConfigurationStepsOrchestrator. Client creates the driver
pod and waits for the application to complete if it's configured to do so,
which is the case by default.
This PR also contains Dockerfiles of the driver and executor images. They are
included because some of the environment variables set in the code would not
make sense without referring to the Dockerfiles.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]