I have a question about the profiles configured in myriad-config-default.yml,
do they have to match parameters specified in yarn-site.xml.
E.g.
myriad-config-default.yml:
large:
cpu: 4
mem: 4096
yarn-site.xml:
<property>
<name>yarn.nodemanager.resource.cpu-vcores</name>
<value>${nodemanager.resource.cpu-vcores}</value>
</property>
<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>${nodemanager.resource.memory-mb}</value>
</property>
I ask because we have large memory/high core count nodes 48 cores/64GB memory.
--
Jonathan (Bill) Sparks
Software Architecture
Cray Inc.