Also from a previous thread on users: ---------- Forwarded message ---------- From: Shubham Pathak <[email protected]> Date: Wed, Jun 15, 2016 at 1:57 AM Subject: Re: Containers Not getting Allocated. To: [email protected]
Hello, This was a Hadoop configuration issue. yarn.nodemanager.resource.cpu-vcores was set to 1. So total vCores available were 3 but the requirement was 4 and hence containers were not getting allocated. On increasing to 8, app got the required resources. Thanks, Shubham _____________________________________ Quote ends Thanks, A _____________________________________ Sent with difficulty, I mean handheld ;) On 12 Jul 2016 7:59 pm, "Aniruddha Thombare" <[email protected]> wrote: > Hi, > > Can you check your YARN memory configuration? > > This may help you: > > http://www.cloudera.com/documentation/enterprise/5-5-x/topics/cdh_ig_yarn_tuning.html > > Thanks, > > A > > _____________________________________ > Sent with difficulty, I mean handheld ;) > On 12 Jul 2016 7:53 pm, "Raja.Aravapalli" <[email protected]> > wrote: > >> >> Hi, >> >> My DAG is failing with memory issues for container. Seeing below >> information in the log. >> >> >> >> Diagnostics: Container [pid=xxx,containerID=container_xyclksdjf] is >> running beyond physical memory limits. Current usage: 1.0 GB of 1 GB >> physical memory used; 2.9 GB of 2.1 GB virtual memory used. Killing >> container. >> >> >> Can someone help me on how I can fix this issue. Thanks a lot. >> >> >> >> Regards, >> Raja. >> >
