[jira] [Commented] (SPARK-40505) Remove min heap setting in Kubernetes Dockerfile entrypoint
[ https://issues.apache.org/jira/browse/SPARK-40505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607151#comment-17607151 ] Apache Spark commented on SPARK-40505: -- User 'bryanck' has created a pull request for this issue: https://github.com/apache/spark/pull/37950 > Remove min heap setting in Kubernetes Dockerfile entrypoint > --- > > Key: SPARK-40505 > URL: https://issues.apache.org/jira/browse/SPARK-40505 > Project: Spark > Issue Type: Improvement > Components: Kubernetes >Affects Versions: 3.3.0, 3.2.2 >Reporter: Bryan Keller >Priority: Major > > The entrypoint script for the Kubernetes Dockerfile sets the Java min heap > setting (-Xms) to be the same as the max setting (-Xmx) for the executor > process. This prevents the JVM from shrinking the heap and can lead to > excessive memory usage in some scenarios. Removing the min heap setting is > consistent with YARN executor startup. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-40505) Remove min heap setting in Kubernetes Dockerfile entrypoint
[ https://issues.apache.org/jira/browse/SPARK-40505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17607149#comment-17607149 ] Apache Spark commented on SPARK-40505: -- User 'bryanck' has created a pull request for this issue: https://github.com/apache/spark/pull/37950 > Remove min heap setting in Kubernetes Dockerfile entrypoint > --- > > Key: SPARK-40505 > URL: https://issues.apache.org/jira/browse/SPARK-40505 > Project: Spark > Issue Type: Improvement > Components: Kubernetes >Affects Versions: 3.3.0, 3.2.2 >Reporter: Bryan Keller >Priority: Major > > The entrypoint script for the Kubernetes Dockerfile sets the Java min heap > setting (-Xms) to be the same as the max setting (-Xmx) for the executor > process. This prevents the JVM from shrinking the heap and can lead to > excessive memory usage in some scenarios. Removing the min heap setting is > consistent with YARN executor startup. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
