Can you please run the tests with -Xms2G added? Sent from a mobile device On Jun 20, 2013, at 6:02 PM, Roman Shaposhnik <r...@apache.org> wrote:
> On Thu, Jun 20, 2013 at 5:59 PM, Suresh Srinivas <sur...@hortonworks.com> > wrote: >> I still need look at hadoop-env.sh > > Bigtopt deployments don't utilize hadoop-env.sh we use /etc/default/hadoop* > for the more precise configuration. > >> I suspect this is due to not passing Xms (starting java heap size) set to >> same >> value as Xmx (max java heap size). The recent inode id changes create hash >> apps based on max heap size and I have seen this problem without Xms. > > Here's the output of ps: > > $ ps -aelf | grep NameNode > 0 S hdfs 28482 1 1 80 0 - 661539 futex_ 00:42 ? > 00:00:13 /usr/java/jdk1.6.0_21/bin/java -Dproc_namenode -Xmx2G > -Dhadoop.log.dir=/var/log/hadoop-hdfs -Dhadoop.log.file=hadoop.log > -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs > -Dhadoop.root.logger=INFO,console > -Djava.library.path=/usr/lib/hadoop/lib/native > -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true > -Dhadoop.log.dir=/var/log/hadoop-hdfs > -Dhadoop.log.file=hadoop-hdfs-namenode-ip-10-144-82-213.log > -Dhadoop.home.dir=/usr/lib/hadoop -Dhadoop.id.str=hdfs > -Dhadoop.root.logger=INFO,RFA > -Djava.library.path=/usr/lib/hadoop/lib/native > -Dhadoop.policy.file=hadoop-policy.xml -Djava.net.preferIPv4Stack=true > -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote > -Dcom.sun.management.jmxremote -Dhadoop.security.logger=INFO,RFAS > org.apache.hadoop.hdfs.server.namenode.NameNode > > > Thanks, > Roman.