Bryan Keller created SPARK-40505:
------------------------------------
Summary: Remove min heap setting in Kubernetes Dockerfile
entrypoint
Key: SPARK-40505
URL: https://issues.apache.org/jira/browse/SPARK-40505
Project: Spark
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 3.2.2, 3.3.0
Reporter: Bryan Keller
The entrypoint script for the Kubernetes Dockerfile sets the Java min heap
setting (-Xms) to be the same as the max setting (-Xmx) for the executor
process. This prevents the JVM from shrinking the heap and can lead to
excessive memory usage in some scenarios. Removing the min heap setting is
consistent with YARN executor startup.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
