Could this be a java/OS issue? Which java and OS are you using? Hari
On Sunday, January 2, 2011, Jon Lederman <[email protected]> wrote: > Hi Esteban, > > Thanks. Can you tell me how I can check whether my node can resolve the host > name? I don't know precisely how to do that. > > When I run HADOOP_ROOT_LOGGER=DEBUG,console hadoop fs -ls / > I get: > > # HADOOP_ROOT_LOGGER=DEBUG,console hadoop fs -ls / > 11/01/02 16:52:14 DEBUG conf.Configuration: java.io.IOException: config() > at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:211) > at org.apache.hadoop.conf.Configuration.<init>(Configuration.java:198) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:57) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79) > at org.apache.hadoop.fs.FsShell.main(FsShell.java:1880) > > 11/01/02 16:52:15 DEBUG security.UserGroupInformation: Unix Login: root,root > 11/01/02 16:52:17 DEBUG security.UserGroupInformation: Unix Login: root,root > 11/01/02 16:52:17 DEBUG ipc.Client: The ping interval is60000ms. > 11/01/02 16:52:18 DEBUG ipc.Client: Connecting to localhost/127.0.0.1:9000 > 11/01/02 16:52:18 DEBUG ipc.Client: IPC Client (47) connection to > localhost/127.0.0.1:9000 from root sending #0 > 11/01/02 16:52:18 DEBUG ipc.Client: IPC Client (47) connection to > localhost/127.0.0.1:9000 from root: starting, having connections 1 > > Then the system hangs and does not return. > > My core-site.xml file is as follows: > > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > > <!-- Put site-specific property overrides in this file. --> > > <configuration> > <property> > <name>fs.default.name</name> > <value>hdfs://localhost:9000</value> > </property> > </configuration> > > > My hdfs-site.xml file is as follows: > > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > > <!-- Put site-specific property overrides in this file. --> > > <configuration> > <property> > <name>dfs.replication</name> > <value>1</value> > </property> > </configuration> > > > My mapred-site.xml file is as follows: > > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > > <!-- Put site-specific property overrides in this file. --> > > <configuration> > <property> > <name>mapred.job.tracker</name> > <value>localhost:9001</value> > </property> > </configuration> > > My masters and slaves files both indicate: localhost > > Thanks for your help. I really appreciate this. > > -Jon > On Jan 2, 2011, at 8:47 AM, Esteban Gutierrez Moguel wrote: > >> Hello Jon, >> >> Could you please verify that your node can resolve the host name? >> >> It would be helpful too if you can attach your configuration files and the >> output of: >> >> HADOOP_ROOT_LOGGER=DEBUG,console hadoop fs -ls / >> >> as Todd suggested. >> >> Cheers, >> esteban >> On Jan 1, 2011 2:01 PM, "Jon Lederman" <[email protected]> wrote: >>> Hi, >>> >>> Still no luck in getting FS commands to work. I did take a look at the >> logs. They all look pretty clean with the following exceptions: The DataNode >> appears to start up fine. However, the NameNode reports that the Network >> Topology has 0 racks and 0 datanodes. Is this normal? Is it possible the >> namenode cannot talk to the datanode? Any thoughts on what might be wrong? >>> >>> Thanks in advance and happy new year. >>> >>> -Jon >>> 2011-01-01 19:45:27,197 INFO >> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG: >>> /************************************************************ >>> STARTUP_MSG: Starting DataNode >>> STARTUP_MSG: host = localhost/127.0.0.1 >>> STARTUP_MSG: args = [] >>> STARTUP_MSG: version = 0.20.2 >>> STARTUP_MSG: build = >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r >> 911707; compiled >>> by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 >>> ************************************************************/ >>> sc-ssh-svr1 logs $ more hadoop-root-namenode-localhost.log >>> 2011-01-01 19:45:23,988 INFO >> org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG: >>> /************************************************************ >>> STARTUP_MSG: Starting NameNode >>> STARTUP_MSG: host = localhost/127.0.0.1 >>> STARTUP_MSG: args = [] >>> STARTUP_MSG: version = 0.20.2 >>> STARTUP_MSG: build = >> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r >> 911707; compiled >>> by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010 >>> ************************************************************/ >>> 2011-01-01 19:45:27,059 INFO org.apache.hadoop.ipc.metrics.RpcMetrics: >> Initializing RPC Metrics with hostName= >>> NameNode, port=8020 >>> 2011-01-01 19:45:28,355 INFO >> org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at: >> localhost.locald >>> omain/127.0.0.1:8020 >>> 2011-01-01 19:45:28,448 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: >> Initializing JVM Metrics with processNa >>> me=NameNode, sessionId=null >>> 2011-01-01 19:45:28,492 INFO >> org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics: Initializing >> Name >>> NodeMeterics using context >> object:org.apache.hadoop.metrics.spi.NullContext >>> 2011-01-01 19:45:29,758 INFO >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=root,root >>> 2011-01-01 19:45:29,763 INFO >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=supergroup >>> 2011-01-01 19:45:29,770 INFO >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: >> isPermissionEnabled=true >>> 2011-01-01 19:45:29,965 INFO >> org.apache.hadoop.hdfs.server.namenode.metrics.FSNamesystemMetrics: >> Initializing >>> FSNamesystemMetrics using context >> object:org.apache.hadoop.metrics.spi.NullContext >>> 2011-01-01 19:45:29,994 INFO >> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered >> FSNamesystemStatu >>> sMBean >>> 2011-01-01 19:45:30,603 INFO org.apache.hadoop.hdfs.server.common.Storage: >> Number of files = 1 >>> 2011-01-01 19:45:30,696 INFO org.apache.hadoop.hdfs.server.common.Storage: >> Number of files under construction >>> = 0 >>> 2011-01-01 19:45:30,701 INFO org.apache.hadoop.hdfs.server.commo
