advancedxy opened a new pull request, #41257: URL: https://github.com/apache/spark/pull/41257
### What changes were proposed in this pull request? 1. reuse SPARK_CONF_DIR config map for executor pods when the cm is already created for driver pod 2. deprecated `spark.kubernetes.executor.disableConfigMap` as it may not be needed any more 3. create config map for executor when running on k8s-client only ### Why are the changes needed? 1. avoid unnecessary config map creation and reduce overhead to K8S 2. code optimize to avoid unnecessary disk file scan to create spark conf config map ### Does this PR introduce _any_ user-facing change? Yes. `spark.kubernetes.executor.disableConfigMap` is deprecated and may not be necessary. ### How was this patch tested? Added UTs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
