Hi, I'm having a few problems getting hadoop to run on a single node. I
had it up and running fine a couple of days ago, and then progressed to
trying to get it going on a small cluster but didn't succeed. So I went
back to running it on a single node, only to find it would no longer
work like that. The HDFS seems to set-up ok, and I can set the browser
to: http://146.169.49.111:50070/dfshealth.jsp and all the details come
up. However, I can't access the jobtracker in a similar way with port
50030. When I try and run a mapreduce job (the wordcount example) I get
the following socket timeout exception:
ray11% bin/hadoop jar hadoop-*-examples.jar wordcount -m 2 -r 3
input/test.txt output
java.net.SocketTimeoutException: timed out waiting for rpc response
at org.apache.hadoop.ipc.Client.call(Client.java:471)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:163)
at $Proxy1.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:247)
at org.apache.hadoop.mapred.JobClient.init(JobClient.java:208)
at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:200)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:528)
at org.apache.hadoop.examples.WordCount.main(WordCount.java:148)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at
org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:143)
at
org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:40)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
My hadoop-site.xml file is set up as follows:
<configuration>
<property>
<name>fs.default.name</name>
<value>146.169.49.111:50010</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>146.169.49.111:50011</value>
</property>
</configuration>
and I'm getting things like this in the log:
2007-06-13 14:55:17,744 WARN org.apache.hadoop.mapred.JobTracker: Error
starting tracker: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind(Native Method)
at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:184)
at org.apache.hadoop.ipc.Server.start(Server.java:621)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:605)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:92)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:1670)
Hope you can help, and let me know if you require any more information.
Thanks in advance,
Ollie