I was able to find the problem. it seems that dev 0.8 will not run on java 1.5. at least not on my cluster.
Gal On Tue, 2005-12-27 at 23:20 +0200, Gal Nitzan wrote: > Hi, > > For some reason I am having trouble setting NDFS on multiple machines I > keep on getting an exception. > > My settings follows the guide lines i.e Doug's cheat sheet on all three > machines: > > <name>fs.default.name</name> > <value>nutchmst1.XXXXXX.com:9000</value> > > all machines seems to be connecting to the namenode: > > 051227 223242 10 Opened server at 50010 > 051227 223242 11 Starting DataNode in: /nutch/ndfs/data/data > 051227 223242 11 using BLOCKREPORT_INTERVAL of 3500482msec > 051227 223242 12 Client connection to x.x.22.185:9000: starting > > 051227 230013 Server connection on port 9000 from x.x.22.186: starting > 051227 230013 Got brand-new heartbeat from nutchnd1:50010 > 051227 230013 Block report from nutchnd1:50010: 0 blocks. > 051227 230013 Server connection on port 9000 from x.x.22.183: starting > 051227 230013 Got brand-new heartbeat from nutchws1:50010 > 051227 230013 Block report from nutchws1:50010: 0 blocks. > > The problem::::::::::: > > [EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt > 051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul > t.xml > 051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x > ml > 051227 230324 No FS indicated, using default:nutchmst1.XXX.com:9000 > 051227 230324 Client connection to x.x.22.185:9000: starting > Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2 > at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234) > [EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt urls > /urls.txt > 051227 230422 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul > t.xml > 051227 230423 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x > ml > 051227 230423 No FS indicated, using default:nutchmst1.xxx.com:9000 > 051227 230423 Client connection to x.x.22.185:9000: starting > Exception in thread "main" java.lang.NullPointerException > at java.net.Socket.<init>(Socket.java:357) > at java.net.Socket.<init>(Socket.java:207) > at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.nextBlockOu > tputStream(NDFSClient.java:573) > at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init>(NDFS > Client.java:521) > at org.apache.nutch.ndfs.NDFSClient.create(NDFSClient.java:83) > at org.apache.nutch.fs.NDFSFileSystem.createRaw(NDFSFileSystem.j > ava:71) > at org.apache.nutch.fs.NFSDataOutputStream$Summer.<init>(NFSData > OutputStream.java:41) > at org.apache.nutch.fs.NFSDataOutputStream.<init>(NFSDataOutputS > tream.java:129) > at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja > va:187) > at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja > va:174) > at org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile(NDFSFileSy > stem.java:178) > at org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile(NDFSFile > System.java:153) > at > org.apache.nutch.fs.NDFSShell.copyFromLocal(NDFSShell.java:46 > ) > at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234) > > > > I know I am missing somthing but I can't figure out what. > > >
