,
YangJie
发件人: vtygoss
日期: 2022年8月25日 星期四 20:02
收件人: spark
主题: memory module of yarn container
Hi, community!
I notice a change about the memory module of yarn container between spark-2.3.0
and spark-3.2.1 when requesting containers from yarn.
org.apache.spark.deploy.yarn.Client.java
Hi, community!
I notice a change about the memory module of yarn container between spark-2.3.0
and spark-3.2.1 when requesting containers from yarn.
org.apache.spark.deploy.yarn.Client.java # verifyClusterResources
```
spark-2.3.0
val executorMem = executorMemory + executorMemoryOverhead