Hi Raja,
Try if this helps. Setting up this property in
yarn-site.xml to more than 10. It specifies the maximum percent of
resources in the cluster which can be used to run the application The
default will be 0.1
<property>
<name>yarn.scheduler.capacity.maximum-am-resource-percent</name>
<value>100</value>
</property>
Thanks and Regards,
Sairam Kannan
On Tue, Jul 12, 2016 at 8:57 AM, Raja.Aravapalli <[email protected]
> wrote:
>
> Hi,
>
> My DAG is failing with memory issues for container. Seeing below
> information in the log.
>
>
>
> Diagnostics: Container [pid=xxx,containerID=container_xyclksdjf] is
> running beyond physical memory limits. Current usage: 1.0 GB of 1 GB
> physical memory used; 2.9 GB of 2.1 GB virtual memory used. Killing
> container.
>
>
> Can someone help me on how I can fix this issue. Thanks a lot.
>
>
>
> Regards,
> Raja.
>
