Hello,
I was able to run NDFS on Win2000 +cygwin only after fixing some issues:
http://issues.apache.org/jira/browse/NUTCH-46
Additionally you can also apply this patch:
http://issues.apache.org/jira/browse/NUTCH-58
Regards,
Piotr
Jay Pound wrote:
ok I've been messing with ndfs for a couple of hours now to determin that it
does not work with windows? I have a linux box the namenode (and datanode)
and 2 pc's with cygwin running as datanodes, I can report with the cygwin
shell and that works, but doing a -mkdir -ls -put does not work, this will
work under linux right now wont it? if so I'll install linux on my windows
boxes. I can create directories and view the directories list on linux, but
I cannot copy data to the filesystem, my guess windows wont write data to
cygwin folder via ndfs. anyway the server end says renewed lease and renews
a few times before the client throws an exception, what java should I be
using for the nightly builds, I've found 1.4.2 to be really good with 0.6
version?
Thanks,
Jay Pound
PS: NDFS is way easier to setup then lustre!!!
PSS: namenode server says file progress failure for /test/content.rdf.u8,
problem with block blk_... with 0 nodes reporting any ideas (probably
windows datanodes)
----- Original Message -----
From: "Doug Cutting" <[EMAIL PROTECTED]>
To: <[email protected]>
Sent: Wednesday, July 06, 2005 3:13 PM
Subject: Re: ndfs stuff
Jay Pound wrote:
I was wondering if in the conf file if I could put in 2 values for the
ndfs.data.dir , if I have 2 hd's in the machine, or should I run 2 copys
of
nutch with different conf's/dirs/ports? also anyone who has used ndfs
did
you find any method to the write once method, best practices?
Currently you'll need to run two ndfs servers, one for each device, or
create a multi-disk volume. But Mike will add support for the feature
you suggest (multiple disks named in ndfs.data.dir) this summer. Look
forward to lots of other improvements to ndfs this summer!
Note that development of ndfs (and MapReduce) is in the mapred branch.
Once we make a 0.7 release this branch will merge into the trunk.
Doug
-------------------------------------------------------
SF.Net email is sponsored by: Discover Easy Linux Migration Strategies
from IBM. Find simple to follow Roadmaps, straightforward articles,
informative Webcasts and more! Get everything you need to get up to
speed, fast. http://ads.osdn.com/?ad_id=7477&alloc_id=16492&op=click
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
