Re: memory module of yarn container

2022-08-25 Thread Yang,Jie(INF)
, YangJie 发件人: vtygoss 日期: 2022年8月25日 星期四 20:02 收件人: spark 主题: memory module of yarn container Hi, community! I notice a change about the memory module of yarn container between spark-2.3.0 and spark-3.2.1 when requesting containers from yarn. org.apache.spark.deploy.yarn.Client.java

memory module of yarn container

2022-08-25 Thread vtygoss
Hi, community! I notice a change about the memory module of yarn container between spark-2.3.0 and spark-3.2.1 when requesting containers from yarn. org.apache.spark.deploy.yarn.Client.java # verifyClusterResources ``` spark-2.3.0 val executorMem = executorMemory + executorMemoryOverhead