Great. Check in the following log files: 1. Check logs in the STRAM ( 001 container in the application - check dt.log ) 2. Check in YARN logs.
You should get some hints/warnings that can be useful to identify the issue. Regards, Sandeep On Wed, Aug 31, 2016 at 5:29 PM, Nitesh Chaudhry < [email protected]> wrote: > Hi > > our yarn-site.xml > > <?xml version="1.0"?> > <!-- > Licensed under the Apache License, Version 2.0 (the "License"); > you may not use this file except in compliance with the License. > You may obtain a copy of the License at > > http://www.apache.org/licenses/LICENSE-2.0 > > Unless required by applicable law or agreed to in writing, software > distributed under the License is distributed on an "AS IS" BASIS, > WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > See the License for the specific language governing permissions and > limitations under the License. See accompanying LICENSE file. > --> > <configuration> > <!-- Site specific YARN configuration properties --> > <property> > <name>yarn.nodemanager.aux-services</name> > <value>mapreduce_shuffle</value> > </property> > <property> > <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name> > <value>org.apache.hadoop.mapred.ShuffleHandler</value> > </property> > <property> > <name>yarn.nodemanager.resource.memory-mb</name> > <value>32000</value> > </property> > </configuration> > > Thanks & Regards > Nitesh Chaudhry > [email protected] > +91-8683000864 > > *Simpli**5**d Technologies* > Audience Intelligence Platform > Simpli5d.com <http://www.simpli5d.com/> | Linkedin > <https://in.linkedin.com/in/amitmittal9> | Facebook > <https://www.facebook.com/Simpli5dTech> > > On 31-Aug-2016, at 5:10 PM, Sandeep Deshmukh <[email protected]> > wrote: > > Could you please paste relevant part of your yarn-site.xml > > Regards, > Sandeep > > On Wed, Aug 31, 2016 at 4:28 PM, Hitesh Goyal <[email protected] > > wrote: > >> Hi, >> >> >> >> We have allocated 32 GB memory using yarn that is provided by you. But it >> is still allocating 7 GB of memory to operators. >> >> >> >> *From:* Priyanka Gugale [mailto:[email protected]] >> *Sent:* Wednesday, August 31, 2016 3:46 PM >> *To:* [email protected] >> *Subject:* Re: Memory Allocation >> >> >> >> Hi Hitesh, >> >> >> >> There was a recent discussion on user forum w.t.r. setting yarn config >> parameters. >> >> https://lists.apache.org/thread.html/fb42b17db17ed5f7f7f3ca0 >> ab84b570fe634e7967fce66efd4aa6280@%3Cusers.apex.apache.org%3E >> >> >> >> Can you check if the suggestions given by Brandon are useful to you? >> >> >> >> -Priyanka >> >> >> >> On Wed, Aug 31, 2016 at 3:17 PM, Hitesh Goyal < >> [email protected]> wrote: >> >> Hi team, >> >> >> >> My server has a memory of around 32 GB. But when I run my application, >> the allocated memory is just 7 GB. No other application is running. >> Operators are not working due to this. How can I extend its memory ?? >> >> >> >> Regards, >> >> *Hitesh Goyal* >> >> Simpli5d Technologies >> >> Cont No.: 9599803307 >> >> >> >> >> > > >
