dongjoon-hyun commented on PR #37950: URL: https://github.com/apache/spark/pull/37950#issuecomment-1256397614
I mean K8s module has been choosing the best practice in K8s control plane and I believe YARN module is the same situation I guess. > You mentioned there is a reason for the different modules, can you explain the reason k8s is configured to use a fixed heap size and YARN does not? I seems that you misunderstand. Your PR description claim like that, not me. This is what you wrote, `settings for the YARN executor process and allows the JVM to reduce the heap when needed to reduce memory consumption.`, in this PR description, isn't it? > I don't follow how a YARN PR will help? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
