Hello Sean, Welcome to the hadoop mailing lists, and thanks for asking your question supplied with good data!
Moving this to cdh-u...@cloudera.org list as you're using the CDH3 version of Apache Hadoop. (bcc'd common-user@hadoop.apache.org and cc'd you) Some questions below: - Can you run "sudo -u hdfs df -kh /var/lib/hadoop-0.20/cache/dfs"? What does the output carry? On Fri, Aug 26, 2011 at 6:23 AM, sean wagner <wagz...@yahoo.com> wrote: > > > Can anyone offer me some insight. It may have been due to me trying to run > the start-all.sh script instead of starting the services. Not sure. > > Thanks > Sean > > > > /************************************************************ > STARTUP_MSG: Starting NameNode > STARTUP_MSG: host = ubuntu-mogile-1/127.0.1.1 > STARTUP_MSG: args = [] > STARTUP_MSG: version = 0.20.2-cdh3u1 > STARTUP_MSG: build = > file:///tmp/nightly_2011-07-18_07-57-52_3/hadoop-0.20-0.20.2+923.97-1~lucid > -r bdafb1dbffd0d5f2fbc6ee022e1c8df6500fd638; compiled by 'root' on Mon Jul 18 > 09:40:01 PDT 2011 > ************************************************************/ > 2011-08-25 17:16:48,653 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: > Initializing JVM Metrics with processName=NameNode, sessionId=null > 2011-08-25 17:16:48,655 INFO > org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics: Initializing > NameNodeMeterics using context > object:org.apache.hadoop.metrics.spi.NoEmitMetricsContext > 2011-08-25 17:16:48,664 INFO org.apache.hadoop.hdfs.util.GSet: VM type > = 64-bit > 2011-08-25 17:16:48,664 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory > = 17.77875 MB > 2011-08-25 17:16:48,665 INFO org.apache.hadoop.hdfs.util.GSet: capacity > = 2^21 = 2097152 entries > 2011-08-25 17:16:48,665 INFO org.apache.hadoop.hdfs.util.GSet: > recommended=2097152, actual=2097152 > 2011-08-25 17:16:48,676 ERROR > org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem > initialization failed. > java.io.IOException: Expecting a line not the end of stream > at > org.apache.hadoop.fs.DF.parseExecResult(DF.java:117) > at org.apache.hadoop.util.Shell.runCommand(Shell.java:237) > at org.apache.hadoop.util.Shell.run(Shell.java:182) > at org.apache.hadoop.fs.DF.getFilesystem(DF.java:63) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.addDirsToCheck(NameNodeResourceChecker.java:87) > at > org.apache.hadoop.hdfs.server.namenode.NameNodeResourceChecker.<init>(NameNodeResourceChecker.java:71) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:348) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:327) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:271) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:465) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1224) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1233) > 2011-08-25 17:16:48,678 ERROR > org.apache.hadoop.hdfs.server.namenode.NameNode: > java.lang.NullPointerException > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.close(FSNamesystem.java:560) > at > org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:330) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:271) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:465) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1224) > at > org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1233) > > 2011-08-25 17:16:48,678 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: > SHUTDOWN_MSG: > /************************************************************ > SHUTDOWN_MSG: Shutting down NameNode at ubuntu-mogile-1/127.0.1.1 > ************************************************************/ > > > > 20$ sudo ls -lR > .: > total 4 > drwxrwxrwx 4 root root 4096 2011-08-25 17:15 cache > > ./cache: > total 8 > drwxr-xr-x 3 hdfs hdfs 4096 2011-08-25 17:15 hdfs > drwxr-xr-x 3 mapred mapred 4096 2011-08-25 17:15 mapred > > ./cache/hdfs: > total 4 > drwxr-xr-x 3 hdfs hdfs 4096 2011-08-25 17:15 dfs > > ./cache/hdfs/dfs: > total 4 > drwx------ 2 hdfs hdfs 4096 2011-08-25 17:15 data > > ./cache/hdfs/dfs/data: > total 0 > > ./cache/mapred: > total 4 > drwxr-xr-x 3 mapred mapred 4096 > 2011-08-25 17:15 mapred > > ./cache/mapred/mapred: > total 4 > drwxr-xr-x 6 mapred mapred 4096 2011-08-25 17:16 local > > ./cache/mapred/mapred/local: > total 16 > drwxr-xr-x 2 mapred mapred 4096 2011-08-25 17:16 taskTracker > drwxr-xr-x 2 mapred mapred 4096 2011-08-25 17:16 toBeDeleted > drwxr-xr-x 2 mapred mapred 4096 2011-08-25 17:16 tt_log_tmp > drwx------ 2 mapred mapred 4096 2011-08-25 17:16 ttprivate > > ./cache/mapred/mapred/local/taskTracker: > total 0 > > ./cache/mapred/mapred/local/toBeDeleted: > total 0 > > ./cache/mapred/mapred/local/tt_log_tmp: > total 0 > > ./cache/mapred/mapred/local/ttprivate: > total 0 -- Harsh J
