ok I've been messing with ndfs for a couple of hours now to determin that it does not work with windows? I have a linux box the namenode (and datanode) and 2 pc's with cygwin running as datanodes, I can report with the cygwin shell and that works, but doing a -mkdir -ls -put does not work, this will work under linux right now wont it? if so I'll install linux on my windows boxes. I can create directories and view the directories list on linux, but I cannot copy data to the filesystem, my guess windows wont write data to cygwin folder via ndfs. anyway the server end says renewed lease and renews a few times before the client throws an exception, what java should I be using for the nightly builds, I've found 1.4.2 to be really good with 0.6 version? Thanks, Jay Pound PS: NDFS is way easier to setup then lustre!!! PSS: namenode server says file progress failure for /test/content.rdf.u8, problem with block blk_... with 0 nodes reporting any ideas (probably windows datanodes) ----- Original Message ----- From: "Doug Cutting" <[EMAIL PROTECTED]> To: <[email protected]> Sent: Wednesday, July 06, 2005 3:13 PM Subject: Re: ndfs stuff
> > Jay Pound wrote: > > I was wondering if in the conf file if I could put in 2 values for the > > ndfs.data.dir , if I have 2 hd's in the machine, or should I run 2 copys of > > nutch with different conf's/dirs/ports? also anyone who has used ndfs did > > you find any method to the write once method, best practices? > > Currently you'll need to run two ndfs servers, one for each device, or > create a multi-disk volume. But Mike will add support for the feature > you suggest (multiple disks named in ndfs.data.dir) this summer. Look > forward to lots of other improvements to ndfs this summer! > > Note that development of ndfs (and MapReduce) is in the mapred branch. > Once we make a 0.7 release this branch will merge into the trunk. > > Doug > >
