dongjoon-hyun opened a new pull request, #56412: URL: https://github.com/apache/spark/pull/56412
### What changes were proposed in this pull request? This PR sets the default value of `spark.kubernetes.executor.useDriverPodIP` to `true` at Apache Spark 4.3.0. ### Why are the changes needed? Introduced in SPARK-53944 (4.1.0), this option lets executor pods connect to the driver pod IP directly instead of the driver's Kubernetes `Service`, bypassing the known K8s DNS issue. Since a Spark driver pod is not restarted during an application, its IP is stable, making this a safe default that avoids DNS lookups. ### Does this PR introduce _any_ user-facing change? Yes. By default, executor pods now connect to the driver via the driver pod IP instead of the driver `Service` DNS name. To restore the legacy behavior, set `spark.kubernetes.executor.useDriverPodIP` to `false`. ### How was this patch tested? Pass the CIs. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Claude Code (Opus 4.8) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
