Harshwardhan Singh Dodiya created SPARK-44050:
-------------------------------------------------
Summary: Unable to Mount ConfigMap in Driver Pod - ConfigMap
Creation Issue
Key: SPARK-44050
URL: https://issues.apache.org/jira/browse/SPARK-44050
Project: Spark
Issue Type: Bug
Components: Kubernetes, Spark Submit
Affects Versions: 3.3.1
Reporter: Harshwardhan Singh Dodiya
Dear Spark community,
I am facing an issue related to mounting a ConfigMap in the driver pod of my
Spark application. Upon investigation, I realized that the problem is caused by
the ConfigMap not being created successfully.
*Problem Description:*
When attempting to mount the ConfigMap in the driver pod, I encounter
consistent failures and my pod stays in containerCreating state. Upon further
investigation, I discovered that the ConfigMap does not exist in the Kubernetes
cluster, which results in the driver pod's inability to access the required
configuration data.
*Additional Information:*
I would like to highlight that this issue is not a frequent occurrence. It has
been observed randomly, affecting the mounting of the ConfigMap in the driver
pod only approximately 5% of the time. This intermittent behavior adds
complexity to the troubleshooting process, as it is challenging to reproduce
consistently.
*Error Message:*
when describing driver pod (kubectl describe pod pod_name) get the below error.
"ConfigMap '<configmap-name>' not found."
*To Reproduce:*
1. Download spark 3.3.1 from [https://spark.apache.org/downloads.html]
2. create an image with "bin/docker-image-tool.sh"
3. Submit on spark-client via bash command by passing all the details and
configurations.
4. Randomly in some of the driver pod we can observe this issue.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
