Stefan,
As an update I am positive everything with dns is setup as it should be.
I can start the namenode service on BoxA and I can also start the
datanode service on boxes B-D. In fact, when I run a bin/nutch ndfs
-report on BoxA it shows the 3 datanodes connected and their stats.
Something is wrong with the jobtracker. Can I have the namenode also be
the jobtracker or would this cause a conflict?
Mike
On Wed, 2005-12-14 at 16:36 -0800, Michael Taggart wrote:
> Ok, I think I have boiled the problem down. Turns out the jobtracker was
> actually never running on my BoxA When I start the program I get this
> error at the end of my jobtracker-log
> Exception in thread "main" java.lang.NullPointerException
> at
> org.apache.nutch.mapred.JobTrackerInfoServer.<init>(JobTrackerInfoServer.java:67)
> at
> org.apache.nutch.mapred.JobTracker.<init>(JobTracker.java:241)
> at
> org.apache.nutch.mapred.JobTracker.startTracker(JobTracker.java:45)
> at org.apache.nutch.mapred.JobTracker.main(JobTracker.java:1070)
>
> Trying to figure out what this means now.
> On Wed, 2005-12-14 at 23:56 +0100, Stefan Groschupf wrote:
> > A common problem is that a boxA says to boxB my name is
> > boxA.localnetwork but boxB can not connect the box with the name
> > boxA.localnetwork since the name from the outside would be somthing
> > like:
> > boxA.companyDomain.com So double check that the name the boxA use to
> > identify itself against other boxes (host.conf) is also setuped in
> > the dns the other boxes use.
> >
> > HTH
> > Stefan
> >
> >
> > Am 14.12.2005 um 22:49 schrieb Michael Taggart:
> >
> > > I've followed the steps in the media-style wiki for setting up a map
> > > reduce system. I am only having one strange error when I attempt to
> > > start the tasktrackers. Here is my output:
> > >
> > > [EMAIL PROTECTED] nutch]# bin/nutch-daemon.sh start tasktracker
> > > starting tasktracker, logging
> > > to /usr/local/nutch/nutch-root-tasktracker-srv08.xxxxx.com.log
> > > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-default.xml
> > > 051214 133808 parsing file:/usr/local/nutch/conf/nutch-site.xml
> > > 051214 133808 Server listener on port 50050: starting
> > > 051214 133808 Server handler 0 on 50050: starting
> > > 051214 133808 Server handler 1 on 50050: starting
> > > 051214 133808 Server listener on port 50040: starting
> > > 051214 133808 Server handler 0 on 50040: starting
> > > 051214 133808 Server handler 1 on 50040: starting
> > > java.net.ConnectException: Connection refused
> > > at java.net.PlainSocketImpl.socketConnect(Native Method)
> > >
> > > I have configured my nutch-site.xml as follows on each box:
> > > ?xml version="1.0"?>
> > > <?xml-stylesheet type="text/xsl" href="nutch-conf.xsl"?>
> > >
> > > <!-- Put site-specific property overrides in this file. -->
> > >
> > > <nutch-conf>
> > > <property>
> > > <name>fs.default.name</name>
> > > <value>srv05.xxxxx.com:50000</value>
> > > <description>The name of the default file system. Either the
> > > literal string "local" or a host:port for NDFS.</description>
> > > </property>
> > > <property>
> > > <name>mapred.job.tracker</name>
> > > <value>srv05.xxxxx.com:50020</value>
> > > <description>The host and port that the MapReduce job tracker runs
> > > at. If "local", then jobs are run in-process as a single map
> > > and reduce task.
> > > </description>
> > > </property>
> > > </nutch-conf>
> > >
> > > srv05 is my namenode and jobtracker. That server starts up the
> > > namenode
> > > and jobtracker services just fine. Maybe I am supposed to reference
> > > fs.default.name as srv08:50000 on srv08? I thought from reading the
> > > mediawiki that I need to reference my BoxA on every other machine.
> > > No firewall on this internal network so I am wondering why I am
> > > getting
> > > a connection refused. Anyone have any ideas?
> > > Thanks,
> > > Mike
> > >
> >
> > ---------------------------------------------------------------
> > company: http://www.media-style.com
> > forum: http://www.text-mining.org
> > blog: http://www.find23.net
> >
> >
