turboFei commented on PR #56781: URL: https://github.com/apache/spark/pull/56781#issuecomment-4803667124
> Why don't we use the existing configurations, e.g., something like spark.kubernetes.driverEnv.MALLOC_ARENA_MAX=4 and spark.executorEnv.MALLOC_ARENA_MAX=4 Thanks for the review. I agree that we can set config for driver/executorEnv, this PR just set the default value to 4 in case some customer is not aware of this change after spark on yarn to kubernetes migration. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
