Once I try and run jstack on it the process does look like it attempts to start
celerwebapp:~ celertechapp$ ps -ef|grep hadoop 502 11073 11012 0 11:59AM ttys000 0:00.01 sh hadoop_admin.sh format 502 11080 11073 0 11:59AM ttys000 0:20.48 /usr/bin/java -Dproc_namenode -Xmx1000m -server -Dceler.hadoop.data.dir=/apps/celertech/deployments/data/hadoop -Dceler.hadoop.master.address=theabyss -Dceler.hadoop.bind.port=50009 -Dcom.sun.management.jmxremote -Dhadoop.log.dir=/apps/celertech/deployments/releases/current/logs/hadoop -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0 -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Djava.library.path=/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/native/ -Dhadoop.policy.file=hadoop-policy.xml -classpath /apps/celertech/deployments/releases/current/conf/hadoop:/apps/celertech/java/lib/tools.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/hadoop-core-0.20.203.0.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/aspectjrt-1.6.5.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/aspectjtools-1.6.5.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-beanutils-1.7.0.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-beanutils-core-1.8.0.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-cli-1.2.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-codec-1.4.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-collections-3.2.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-configuration-1.6.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-daemon-1.0.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-digester-1.8.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-el-1.0.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-httpclient-3.0.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-lang-2.4.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-logging-1.1.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-logging-api-1.0.4.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-math-2.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/commons-net-1.4.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/core-3.1.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/hsqldb-1.8.0.10.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jackson-core-asl-1.0.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jackson-mapper-asl-1.0.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jasper-compiler-5.5.12.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jasper-runtime-5.5.12.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jets3t-0.6.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jetty-6.1.26.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jetty-util-6.1.26.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jsch-0.1.42.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/junit-4.5.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/kfs-0.2.2.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/log4j-1.2.15.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/mockito-all-1.8.5.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/oro-2.0.8.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/servlet-api-2.5-20081211.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/slf4j-api-1.4.3.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/slf4j-log4j12-1.4.3.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/xmlenc-0.52.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jsp-2.1/jsp-2.1.jar:/apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/lib/jsp-2.1/jsp-api-2.1.jar org.apache.hadoop.hdfs.server.namenode.NameNode -format celerwebapp:~ celertechapp$ jps 11106 Jps celerwebapp:~ celertechapp$ jstack 11080 11080: Unable to open socket file: target process not responding or HotSpot VM not loaded The -F option can be used when the target process is not responding celerwebapp:~ celertechapp$ Very strange... On 31 Mar 2012, at 10:47, Harsh J wrote: > Ben, > > Why are there two processes trying a format? > > You may jstack their PIDs to see where they are hung. > > On Sat, Mar 31, 2012 at 2:50 PM, Ben Cuthbert <bencuthb...@ymail.com> wrote: >> All >> >> for some reason when I run the format on the namenode it just hangs >> >> I see the process running >> >> theabyss:$ ps -ef|grep hadoop >> 502 37859 33043 0 10:19am ttys006 0:00.00 grep hadoop >> 503 37831 37395 0 10:19am ttys009 0:00.00 sh hadoop_admin.sh format >> 503 37838 37831 0 10:19am ttys009 0:00.01 bash >> /apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/bin/hadoop >> -x namenode -format >> 503 37855 37838 0 10:19am ttys009 0:00.00 bash >> /apps/celertech/deployments/releases/current/services/hadoop-0.20.203.0/bin/hadoop >> -x namenode -format >> 503 37856 37855 0 10:19am ttys009 0:04.80 /usr/bin/java -Xmx32m >> org.apache.hadoop.util.PlatformName >> theabyss:$ >> >> But the command line shows not output. Is there a way to debug this? >> >> > > > > -- > Harsh J
