Hi,
I've been googling, but haven't been able to find an answer. I'm
currently trying to setup Hadoop in pseudo-distributed mode as a first
step. I'm using the Cloudera distro and installed everything through YUM
on CentOS 5.7. I can run everything just fine from my one node itself
(hadoop fs -ls /, test map-red jobs, etc...), but can't get a remote
client to be able to connect to it. I'm pretty sure the cause of that
has to do with the fact that port 8020 and port 8021 do not seem to be
listening (when I do a netstat -a, they don't show up-- all the other
Hadoop related ports like 50030 and 50070 do show up). I verified that
the firewall allows connections over 8020 and 8021 for tcp, and can
connect through my web browser to 50030 and 50070.
Looking at the namenode log, I see the following error which looks
suspicious and related to me:
2012-01-09 12:03:38,000 INFO org.apache.hadoop.ipc.Server: IPC
Server listener on 8020: starting
2012-01-09 12:03:38,009 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 0 on 8020: starting
2012-01-09 12:03:39,187 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 2 on 8020: starting
2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 3 on 8020: starting
2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 4 on 8020: starting
2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 5 on 8020: starting
2012-01-09 12:03:39,188 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 6 on 8020: starting
2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 1 on 8020: starting
2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 7 on 8020: starting
2012-01-09 12:03:39,189 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 8 on 8020: starting
2012-01-09 12:03:39,246 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 9 on 8020: starting
2012-01-09 12:03:39,258 WARN
org.apache.hadoop.util.PluginDispatcher: Unable to load
dfs.namenode.plugins plugins
2012-01-09 12:03:40,254 INFO org.apache.hadoop.ipc.Server: IPC
Server handler 8 on 8020, call
addBlock(/var/lib/hadoop-0.20/cache/mapred/mapred/system/jobtracker.info,
DFSClient_-1779116177, null) from 127.0.0.1:39785: error:
java.io.IOException: File
/var/lib/hadoop-0.20/cache/mapred/mapred/system/jobtracker.info
could only be replicated to 0 nodes, instead of 1
Anyone have any idea what my problem might be?
Cheers,
Eli
