Interesting!
That is not a feature that is a bug, may you can open a minor bug
report.
Thanks.
Stefan
Am 28.12.2005 um 01:35 schrieb Gal Nitzan:
Thanks for the prompt reply. However it seems that the problem was
working with JDK 1.5
When changed to 1.4.2 All seems to be working.
Thanks.
Gal.
On Wed, 2005-12-28 at 01:24 +0100, Stefan Groschupf wrote:
The exception means that one client is unable to connect to one
*datanode*.
Check that the box that had this exception can open a connection to
all other datanodes with the correct port.
try
telnet machineNameAsUsedInNameNode DATANODE_PORT
Is it able to connect?
Stefan
Am 27.12.2005 um 22:20 schrieb Gal Nitzan:
Hi,
For some reason I am having trouble setting NDFS on multiple
machines I
keep on getting an exception.
My settings follows the guide lines i.e Doug's cheat sheet on all
three
machines:
<name>fs.default.name</name>
<value>nutchmst1.XXXXXX.com:9000</value>
all machines seems to be connecting to the namenode:
051227 223242 10 Opened server at 50010
051227 223242 11 Starting DataNode in: /nutch/ndfs/data/data
051227 223242 11 using BLOCKREPORT_INTERVAL of 3500482msec
051227 223242 12 Client connection to x.x.22.185:9000: starting
051227 230013 Server connection on port 9000 from x.x.22.186:
starting
051227 230013 Got brand-new heartbeat from nutchnd1:50010
051227 230013 Block report from nutchnd1:50010: 0 blocks.
051227 230013 Server connection on port 9000 from x.x.22.183:
starting
051227 230013 Got brand-new heartbeat from nutchws1:50010
051227 230013 Block report from nutchws1:50010: 0 blocks.
The problem:::::::::::
[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-
defaul
t.xml
051227 230324 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-
site.x
ml
051227 230324 No FS indicated, using default:nutchmst1.XXX.com:9000
051227 230324 Client connection to x.x.22.185:9000: starting
Exception in thread "main"
java.lang.ArrayIndexOutOfBoundsException: 2
at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)
[EMAIL PROTECTED] trunk]$ bin/nutch ndfs -copyFromLocal urls.txt
urls
/urls.txt
051227 230422 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-
defaul
t.xml
051227 230423 parsing file:/home/nutchuser/nutch/trunk/conf/nutch-
site.x
ml
051227 230423 No FS indicated, using default:nutchmst1.xxx.com:9000
051227 230423 Client connection to x.x.22.185:9000: starting
Exception in thread "main" java.lang.NullPointerException
at java.net.Socket.<init>(Socket.java:357)
at java.net.Socket.<init>(Socket.java:207)
at org.apache.nutch.ndfs.NDFSClient
$NDFSOutputStream.nextBlockOu
tputStream(NDFSClient.java:573)
at org.apache.nutch.ndfs.NDFSClient$NDFSOutputStream.<init>
(NDFS
Client.java:521)
at org.apache.nutch.ndfs.NDFSClient.create
(NDFSClient.java:83)
at org.apache.nutch.fs.NDFSFileSystem.createRaw
(NDFSFileSystem.j
ava:71)
at org.apache.nutch.fs.NFSDataOutputStream$Summer.<init>
(NFSData
OutputStream.java:41)
at org.apache.nutch.fs.NFSDataOutputStream.<init>
(NFSDataOutputS
tream.java:129)
at org.apache.nutch.fs.NutchFileSystem.create
(NutchFileSystem.ja
va:187)
at org.apache.nutch.fs.NutchFileSystem.create
(NutchFileSystem.ja
va:174)
at org.apache.nutch.fs.NDFSFileSystem.doFromLocalFile
(NDFSFileSy
stem.java:178)
at org.apache.nutch.fs.NDFSFileSystem.copyFromLocalFile
(NDFSFile
System.java:153)
at
org.apache.nutch.fs.NDFSShell.copyFromLocal(NDFSShell.java:
46 )
at org.apache.nutch.fs.NDFSShell.main(NDFSShell.java:234)
I know I am missing somthing but I can't figure out what.
---------------------------------------------------------------
company: http://www.media-style.com
forum: http://www.text-mining.org
blog: http://www.find23.net
---------------------------------------------------------------
company: http://www.media-style.com
forum: http://www.text-mining.org
blog: http://www.find23.net
