arunmahadevan commented on a change in pull request #24630: [SPARK-27754][K8S]
Introduce config for driver request cores
URL: https://github.com/apache/spark/pull/24630#discussion_r285210301
##########
File path: docs/running-on-kubernetes.md
##########
@@ -793,6 +793,15 @@ See the [configuration page](configuration.html) for
information on Spark config
Interval between reports of the current Spark job status in cluster mode.
</td>
</tr>
+<tr>
+ <td><code>spark.kubernetes.driver.request.cores</code></td>
+ <td>(none)</td>
+ <td>
+ Specify the cpu request for the driver pod. Values conform to the
Kubernetes <a
href="https://kubernetes.io/docs/concepts/configuration/manage-compute-resources-container/#meaning-of-cpu";>convention</a>.
+ Example values include 0.1, 500m, 1.5, 5, etc., with the definition of cpu
units documented in <a
href="https://kubernetes.io/docs/tasks/configure-pod-container/assign-cpu-resource/#cpu-units";>CPU
units</a>.
+ This takes precedence over <code>spark.driver.cores</code> for specifying
the driver pod cpu request if set.
Review comment:
Yes and also since we already have `spark.kubernetes.executor.request.cores`
for executor but similar is missing for driver.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
