yes my job has about 160,000 maps and my cluster not getting fully utilized
around 6000 maps ran for 2 hrs and then I killed the job. At any point of
time only 40 containers are running thats just 11% of my cluster capacity.
{
"classification": "mapred-site",
"properties": {
What should I be looking for if my 24-node cluster in not launching enough
containers?
only 40/288 cores are used and 87GB/700GB is memory is used.
Yarn.nodemanager memory/core conf look good. And so do container
memory/core conf.
Thanks
Nishchay Malhotra
