I had exactly similler problem with JDK 1.5. Also when I worked with only one data node problem doesn't occur.
Thanks On 12/28/05, Stefan Groschupf <[EMAIL PROTECTED]> wrote: > Interesting! > That is not a feature that is a bug, may you can open a minor bug > report. > Thanks. > Stefan > Am 28.12.2005 um 01:35 schrieb Gal Nitzan: > > > Thanks for the prompt reply. However it seems that the problem was > > working with JDK 1.5 > > > > When changed to 1.4.2 All seems to be working. > > > > Thanks. > > > > Gal. > > On Wed, 2005-12-28 at 01:24 +0100, Stefan Groschupf wrote: > >> The exception means that one client is unable to connect to one > >> *datanode*. > >> Check that the box that had this exception can open a connection to > >> all other datanodes with the correct port. > >> try > >> telnet machineNameAsUsedInNameNode DATANODE_PORT > >> > >> Is it able to connect? > >> > >> Stefan > >> > >> Am 27.12.2005 um 22:20 schrieb Gal Nitzan: > >> > >>> Hi, > >>> > >>> For some reason I am having trouble setting NDFS on multiple > >>> machines I > >>> keep on getting an exception. > >>> > >>> My settings follows the guide lines i.e Doug's cheat sheet on all > >>> three > >>> machines: > >>> > >>> <name>fs.default.name</name> > >>> <value>nutchmst1.XXXXXX.com:9000</value> > >>> > >>> all machines seems to be connecting to the namenode: > >>> > >>> 051227 223242 10 Opened server at 50010 > >>> 051227 223242 11 Starting DataNode in: /nutch/ndfs/data/data > >>> 051227 223242 11 using BLOCKREPORT_INTERVAL of 3500482msec > >>> 051227 223242 12 Client connection to x.x.22.185:9000: starting > >>> > >>> 051227 230013 Server connection on port 9000 from x.x.22.186: > >>> starting > >>> 051227 230013 Got brand-new heartbeat from nutchnd1:50010 > >>> 051227 230013 Block report from nutchnd1:50010: 0 blocks. > >>> 051227 230013 Server connection on port 9000 from x.x.22.183: > >>> starting > >>> 051227 230013 Got brand-new heartbeat from nutchws1:50010 > >>> 051227 230013 Block report from nutchws1:50010: 0 blocks. > >>> > >>> The problem::::::::::: > >>> > >>> [EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt > >>> 051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- > >>> defaul > >>> t.xml > >>> 051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- > >>> site.x > >>> ml > >>> 051227 230324 No FS indicated, using default:nutchmst1.XXX.com:9000 > >>> 051227 230324 Client connection to x.x.22.185:9000: starting > >>> Exception in thread "main" > >>> java.lang.ArrayIndexOutOfBoundsException: 2 > >>> at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234) > >>> [EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt > >>> urls > >>> /urls.txt > >>> 051227 230422 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- > >>> defaul > >>> t.xml > >>> 051227 230423 parsing file:/home/nutchuser/nutch/trunk/conf/nutch- > >>> site.x > >>> ml > >>> 051227 230423 No FS indicated, using default:nutchmst1.xxx.com:9000 > >>> 051227 230423 Client connection to x.x.22.185:9000: starting > >>> Exception in thread "main" java.lang.NullPointerException > >>> at java.net.Socket.<init>(Socket.java:357) > >>> at java.net.Socket.<init>(Socket.java:207) > >>> at org.apache.nutch.ndfs.NDFSClient > >>> $NDFSOutputStream.nextBlockOu > >>> tputStream(NDFSClient.java:573) > >>> at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init> > >>> (NDFS > >>> Client.java:521) > >>> at org.apache.nutch.ndfs.NDFSClient.create > >>> (NDFSClient.java:83) > >>> at org.apache.nutch.fs.NDFSFileSystem.createRaw > >>> (NDFSFileSystem.j > >>> ava:71) > >>> at org.apache.nutch.fs.NFSDataOutputStream$Summer.<init> > >>> (NFSData > >>> OutputStream.java:41) > >>> at org.apache.nutch.fs.NFSDataOutputStream.<init> > >>> (NFSDataOutputS > >>> tream.java:129) > >>> at org.apache.nutch.fs.NutchFileSystem.create > >>> (NutchFileSystem.ja > >>> va:187) > >>> at org.apache.nutch.fs.NutchFileSystem.create > >>> (NutchFileSystem.ja > >>> va:174) > >>> at org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile > >>> (NDFSFileSy > >>> stem.java:178) > >>> at org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile > >>> (NDFSFile > >>> System.java:153) > >>> at > >>> org.apache.nutch.fs.NDFSShell.copyFromLocal(NDFSShell.java: > >>> 46 ) > >>> at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234) > >>> > >>> > >>> > >>> I know I am missing somthing but I can't figure out what. > >>> > >>> > >>> > >> > >> --------------------------------------------------------------- > >> company: http://www.media-style.com > >> forum: http://www.text-mining.org > >> blog: http://www.find23.net > >> > >> > > > > > > > > --------------------------------------------------------------- > company: http://www.media-style.com > forum: http://www.text-mining.org > blog: http://www.find23.net > > > >
