Chenyu Zheng created SPARK-58202:
------------------------------------
Summary: Skip driver containerPort declaration when the port is 0
Key: SPARK-58202
URL: https://issues.apache.org/jira/browse/SPARK-58202
Project: Spark
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 4.3.0
Reporter: Chenyu Zheng
Setting {{spark.driver.port}} / {{spark.driver.blockManager.port}} /
{{spark.ui.port}} / {{spark.connect.grpc.binding.port}} to 0 makes driver Pod
creation fail. The error log is as follows:
{code:java}
Exception in thread "main"
io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: POST
at: https://XX.XX.XX.XX:443/api/v1/namespaces/default/pods. Message: Pod
"xxx-driver" is invalid: [spec.containers[0].ports[0].containerPort: Required
value, spec.containers[0].ports[1].containerPort: Required value ...
{code}
BasicExecutorFeatureStep already skips the entry when the port is 0. The driver
side should follow the same pattern.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
