is there anything done with hardware? i used thinkpad t430,this problem occurs,but i used about 100 machines ,there is nothing to do with this ,all the machines is redhat 6.0,and the jdk is jdk1.5 to jdk1.6 , so i think there is something to do with the hardware，any idea?
2013/1/22 Jean-Marc Spaggiari <[email protected]> > Hi Sean, > > Will you be able to run the memtest86 on this VM? Maybe it's an issue > with the way the VM is managing the memory? > > I ran HBase+Hadoop on a desktop with only 1.5G. So you should not have > any issue with 6GB. > > I don't think the issue you are facing is related to hadoop. Can you > try to run a simple Java application in you JVM? Something which will > use lot of memory. And see if it works? > > JM > > 2013/1/22, Sean Hudson <[email protected]>: > > Hi Jean-Marc, > > The Linux machine on which I am attempting to get > > Hadoop running is actually Linux running in a VM partition. This VM > > partition had 2 Gigs of RAM when I first encountered the problem. This > RAM > > allocation has been bumped up to 6 Gigs, but the problem still persists, > > i.e > > > > bin/hadoop jar hadoop-*-examples.jar grep input output 'dfs[a-z.]+' > still > > crashes out as before. > > > > Is there a minimum RAM size requirement? > > Will Hadoop run correctly on Linux in a VM partition? > > > > I had attempted to run Hadoop in > Pseudo-Distributed > > > > Operation mode and this included modifying the conf/core-site.xml, > > conf/hdfs-site.xml and the conf/mapred-site.xml files as per the Quick > Start > > > > instructions. I also formatted a new distributed-filesystem as per the > > instructions. To re-test in Standalone mode with 6 Gigs of RAM, I > reversed > > the changes to the above three .xml files in /conf. However, I don't see > a > > way to back-out the distributed-filesystem. Will the existence of this > > distributed-filesystem interfere with my Standalone tests? > > > > Regards, > > > > Sean Hudson > > > > -----Original Message----- > > From: Jean-Marc Spaggiari > > Sent: Friday, January 18, 2013 3:24 PM > > To: [email protected] > > Subject: Re: Problems > > > > Hi Sean, > > > > It's strange. You should not faced that. I faced same kind of issues > > on a desktop with memory errors. Can you install memtest86 and fullty > > test your memory (one pass is enought) to make sure you don't have > > issues on that side? > > > > 2013/1/18, Sean Hudson <[email protected]>: > >> Leo, > >> I downloaded the suggested 1.6.0_32 Java version to my home > >> directory, but I am still experiencing the same problem (See error > >> below). > >> The only thing that I have set in my hadoop-env.sh file is the JAVA_HOME > >> environment variable. I have also tried it with the Java directory added > >> to > >> > >> PATH. > >> > >> export JAVA_HOME=/home/shu/jre1.6.0_32 > >> export PATH=$PATH:/home/shu/jre1.6.0_32 > >> > >> Every other environment variable is defaulted. > >> > >> Just to clarify, I have tried this in Local Standalone mode and also in > >> Pseudo-Distributed Mode with the same result. > >> > >> Frustrating to say the least, > >> > >> Sean Hudson > >> > >> > >> shu@meath-nua:~/hadoop-1.0.4> bin/hadoop jar hadoop-examples-1.0.4.jar > >> grep > >> > >> input output 'dfs[a-z.]+' > >> # > >> # A fatal error has been detected by the Java Runtime Environment: > >> # > >> # SIGFPE (0x8) at pc=0xb7fc51fb, pid=23112, tid=3075554208 > >> # > >> # JRE version: 6.0_32-b05 > >> # Java VM: Java HotSpot(TM) Client VM (20.7-b02 mixed mode, sharing > >> linux-x86 ) > >> # Problematic frame: > >> # C [ld-linux.so.2+0x91fb] double+0xab > >> # > >> # An error report file with more information is saved as: > >> # /home/shu/hadoop-1.0.4/hs_err_pid23112.log > >> # > >> # If you would like to submit a bug report, please visit: > >> # http://java.sun.com/webapps/bugreport/crash.jsp > >> # The crash happened outside the Java Virtual Machine in native code. > >> # See problematic frame for where to report the bug. > >> # > >> Aborted > >> > >> -----Original Message----- > >> From: Leo Leung > >> Sent: Thursday, January 17, 2013 6:46 PM > >> To: [email protected] > >> Subject: RE: Problems > >> > >> Use Sun/Oracle 1.6.0_32+ Build should be 20.7-b02+ > >> > >> 1.7 causes failure and AFAIK, not supported, but you are free to try > >> the > >> latest version and report back. > >> > >> > >> > >> -----Original Message----- > >> From: Sean Hudson [mailto:[email protected]] > >> Sent: Thursday, January 17, 2013 6:57 AM > >> To: [email protected] > >> Subject: Re: Problems > >> > >> Hi, > >> My Java version is > >> > >> java version "1.6.0_25" > >> Java(TM) SE Runtime Environment (build 1.6.0_25-b06) Java HotSpot(TM) > >> Client > >> > >> VM (build 20.0-b11, mixed mode, sharing) > >> > >> Would you advise obtaining a later Java version? > >> > >> Sean > >> > >> -----Original Message----- > >> From: Jean-Marc Spaggiari > >> Sent: Thursday, January 17, 2013 2:52 PM > >> To: [email protected] > >> Subject: Re: Problems > >> > >> Hi Sean, > >> > >> This is an issue with your JVM. Not related to hadoop. > >> > >> Which JVM are you using, and can you try with the last from Sun? > >> > >> JM > >> > >> 2013/1/17, Sean Hudson <[email protected]>: > >>> Hi, > >>> I have recently installed hadoop-1.0.4 on a linux machine. > >>> Whilst working through the post-install instructions contained in the > >>> “Quick Start” > >>> guide, I incurred the following catastrophic Java runtime error (See > >>> below). > >>> I have attached the error report file “hs_err_pid24928.log”. I have > >>> submitted a Java bug report, but perhaps it is a known hadoop-1.0.4 > >>> version problem. > >>> > >>> I am a first time user of Hadoop and would welcome guidance on this > >>> problem, > >>> > >>> Regards, > >>> > >>> Sean Hudson. > >>> > >>> shu@meath-nua:~/hadoop-1.0.4> bin/hadoop jar hadoop-examples-1.0.4.jar > >>> grep input output 'dfs[a-z.]+' > >>> # > >>> # A fatal error has been detected by the Java Runtime Environment: > >>> # > >>> # SIGFPE (0x8) at pc=0xb7f2b1fb, pid=24928, tid=3074923424 # # JRE > >>> version: 6.0_25-b06 # Java VM: Java HotSpot(TM) Client VM (20.0-b11 > >>> mixed mode, sharing > >>> linux-x86 ) > >>> # Problematic frame: > >>> # C [ld-linux.so.2+0x91fb] double+0xab # # An error report file with > >>> more information is saved as: > >>> # /home/shu/hadoop-1.0.4/hs_err_pid24928.log > >>> # > >>> # If you would like to submit a bug report, please visit: > >>> # http://java.sun.com/webapps/bugreport/crash.jsp > >>> # The crash happened outside the Java Virtual Machine in native code. > >>> # See problematic frame for where to report the bug. > >>> # > >>> Aborted > >>> -- > >>> Ostia Software Solutions Limited, 6 The Mill Building, The Maltings, > >>> Bray, Co. Wicklow, Ireland > >>> > >>> Registered in Ireland CRO No.507541 This email and any attachments to > >>> it is, unless otherwise stated, confidential, may contain copyright > >>> material and is for the use of the intended recipient only. If you > >>> have received this email in error, please notify the sender by return > >>> and deleting all copies. Any views expressed in this email are those > >>> of the sender and do not form part of any contract between Ostia > >>> Software Solutions Limited and any other party. > >>> > >> > >> > >> -- > >> Ostia Software Solutions Limited, 6 The Mill Building, The Maltings, > >> Bray, > >> Co. Wicklow, Ireland > >> > >> Registered in Ireland CRO No.507541 This email and any attachments to it > >> is, > >> > >> unless otherwise stated, confidential, may contain copyright material > and > >> > >> is > >> > >> for the use of the intended recipient only. If you have received this > >> email > >> > >> in error, please notify the sender by return and deleting all copies. > Any > >> views expressed in this email are those of the sender and do not form > >> part > >> of any contract between Ostia Software Solutions Limited and any other > >> party. > >> > >> > >> -- > >> Ostia Software Solutions Limited, 6 The Mill Building, The Maltings, > >> Bray, > >> Co. Wicklow, Ireland > >> > >> Registered in Ireland CRO No.507541 This email and any attachments to it > >> is, unless otherwise stated, confidential, may contain copyright > material > >> and is for the use of the intended recipient only. If you have received > >> this email in error, please notify the sender by return and deleting all > >> copies. Any views expressed in this email are those of the sender and do > >> not form part of any contract between Ostia Software Solutions Limited > >> and > >> any other party. > >> > > > > > > -- > > Ostia Software Solutions Limited, 6 The Mill Building, The Maltings, > Bray, > > Co. Wicklow, Ireland > > > > Registered in Ireland CRO No.507541 This email and any attachments to it > > is, unless otherwise stated, confidential, may contain copyright material > > and is for the use of the intended recipient only. If you have received > > this email in error, please notify the sender by return and deleting all > > copies. Any views expressed in this email are those of the sender and do > > not form part of any contract between Ostia Software Solutions Limited > and > > any other party. > > >
