Hi,
For some reason I am having trouble setting NDFS on multiple machines I
keep on getting an exception.
My settings follows the guide lines i.e Doug's cheat sheet on all three
machines:
<name>fs.default.name</name>
<value>nutchmst1.XXXXXX.com:9000</value>
all machines seems to be connecting to the namenode:
051227 223242 10 Opened server at 50010
051227 223242 11 Starting DataNode in: /nutch/ndfs/data/data
051227 223242 11 using BLOCKREPORT_INTERVAL of 3500482msec
051227 223242 12 Client connection to x.x.22.185:9000: starting
051227 230013 Server connection on port 9000 from x.x.22.186: starting
051227 230013 Got brand-new heartbeat from nutchnd1:50010
051227 230013 Block report from nutchnd1:50010: 0 blocks.
051227 230013 Server connection on port 9000 from x.x.22.183: starting
051227 230013 Got brand-new heartbeat from nutchws1:50010
051227 230013 Block report from nutchws1:50010: 0 blocks.
The problem:::::::::::
[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul
t.xml
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x
ml
051227 230324 No FS indicated, using default:nutchmst1.XXX.com:9000
051227 230324 Client connection to x.x.22.185:9000: starting
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: 2
at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)
[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt urls
/urls.txt
051227 230422 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-defaul
t.xml
051227 230423 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-site.x
ml
051227 230423 No FS indicated, using default:nutchmst1.xxx.com:9000
051227 230423 Client connection to x.x.22.185:9000: starting
Exception in thread "main" java.lang.NullPointerException
at java.net.Socket.<init>(Socket.java:357)
at java.net.Socket.<init>(Socket.java:207)
at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.nextBlockOu
tputStream(NDFSClient.java:573)
at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init>(NDFS
Client.java:521)
at org.apache.nutch.ndfs.NDFSClient.create(NDFSClient.java:83)
at org.apache.nutch.fs.NDFSFileSystem.createRaw(NDFSFileSystem.j
ava:71)
at org.apache.nutch.fs.NFSDataOutputStream$Summer.<init>(NFSData
OutputStream.java:41)
at org.apache.nutch.fs.NFSDataOutputStream.<init>(NFSDataOutputS
tream.java:129)
at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja
va:187)
at org.apache.nutch.fs.NutchFileSystem.create(NutchFileSystem.ja
va:174)
at org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile(NDFSFileSy
stem.java:178)
at org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile(NDFSFile
System.java:153)
at
org.apache.nutch.fs.NDFSShell.copyFromLocal(NDFSShell.java:46
)
at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)
I know I am missing somthing but I can't figure out what.
