Re: Is append allowed in HDFS?

2012-04-13 Thread Florin P
Hello!  Thank you all for all responses. It is possible to have a matrix of hadoop file input format that supports append or if I understood correctly, all formats are now supporting append? Thanks a lot.   Regards,  Florin From: Inder Pall To: hdfs-user@hado

Re: Is append allowed in HDFS?

2012-04-13 Thread Ioan Eugen Stan
2012/4/13 Florin P : > Hello! >  Thank you all for all responses. It is possible to have a matrix of > hadoop > file input format that supports append or if I understood correctly, all > formats are now supporting append? > Thanks a lot. >   Regards, >  Florin Hi Florin, Append is a file-system f

Best way to get data out of HDFS to other platforms

2012-04-13 Thread Mapred Learn
Hi All, I was trying to find out the best options to get data out of HDFS to other platforms like AIX with parameters like reliability, performance and parallelism and data integrity in mind. Thanks, Sent from my iPhone

Re: Best way to get data out of HDFS to other platforms

2012-04-13 Thread Mac Noland
There are probably much, much, much better and more standard ways, but in the simple push and pulls I've done, I've just rolled my own.     public void copyFileFromHDFS(String src, String dest, boolean overWrite) throws IOException{         Path hdfsPath = new Path(src);         FSDataInputStre

Re: Best way to get data out of HDFS to other platforms

2012-04-13 Thread Mapred Learn
This is for copying to Linux locally I m talking about cross platform where you want to get data to systems like AIX where these APIs don't work. Sent from my iPhone On Apr 13, 2012, at 1:02 PM, Dave Shine wrote: > fs.copyToLocal(sourcePath, destinationPath); > > > > Am I missing somethin

Re: Best way to get data out of HDFS to other platforms

2012-04-13 Thread mcdonaldnol...@yahoo.com
Does java have a dist for aix. I think this works on any platform java runs on. Including this phone. I think. Sent from my HTC on the Now Network from Sprint! - Reply message - From: "Mapred Learn" Date: Fri, Apr 13, 2012 3:24 pm Subject: Best way to get data out of HDFS to other plat