RE: set reduced block size for a specific file

2011-08-30 Thread Ben Clay
/dest/path Ben Clay rbc...@ncsu.edu -Original Message- From: Todd Lipcon [mailto:t...@cloudera.com] Sent: Tuesday, August 30, 2011 10:45 AM To: hdfs-user@hadoop.apache.org Subject: Re: set reduced block size for a specific file 0.21 has some bugs with config option deprecation that you&

Re: set reduced block size for a specific file

2011-08-30 Thread Todd Lipcon
t;> > >> > I just filed this JIRA to add this feature: >> > https://issues.apache.org/jira/browse/HDFS-2293 >> > >> > If anyone would like to implement this, I would be happy to >> review it. >> > >> > Thanks a lot, >>

RE: set reduced block size for a specific file

2011-08-30 Thread Ben Clay
tware Engineer, Cloudera > > > > > > > > On Sat, Aug 27, 2011 at 4:08 PM, Ben Clay wrote: > > > >> I didn't even think of overriding the config dir. Thanks for > the tip! > >> > >> -Ben > >> > >> > >> -O

Re: set reduced block size for a specific file

2011-08-28 Thread Uma Maheswara Rao G 72686
dera > > > > > > > > On Sat, Aug 27, 2011 at 4:08 PM, Ben Clay wrote: > > > >> I didn't even think of overriding the config dir. Thanks for > the tip! > >> > >> -Ben > >> > >> > >> -Original Message-

Re: set reduced block size for a specific file

2011-08-27 Thread Praveen Sripati
ink of overriding the config dir. Thanks for the tip! >> >> -Ben >> >> >> -Original Message- >> From: Allen Wittenauer [mailto:a...@apache.org] >> Sent: Saturday, August 27, 2011 6:42 PM >> To: hdfs-user@hadoop.apache.org >> Cc: rbc...@ncsu.

Re: set reduced block size for a specific file

2011-08-27 Thread Aaron T. Myers
: > I didn't even think of overriding the config dir. Thanks for the tip! > > -Ben > > > -Original Message- > From: Allen Wittenauer [mailto:a...@apache.org] > Sent: Saturday, August 27, 2011 6:42 PM > To: hdfs-user@hadoop.apache.org > Cc: rbc...@ncsu.edu &g

RE: set reduced block size for a specific file

2011-08-27 Thread Ben Clay
I didn't even think of overriding the config dir. Thanks for the tip! -Ben -Original Message- From: Allen Wittenauer [mailto:a...@apache.org] Sent: Saturday, August 27, 2011 6:42 PM To: hdfs-user@hadoop.apache.org Cc: rbc...@ncsu.edu Subject: Re: set reduced block size for a spe

Re: set reduced block size for a specific file

2011-08-27 Thread Allen Wittenauer
On Aug 27, 2011, at 12:42 PM, Ted Dunning wrote: > There is no way to do this for standard Apache Hadoop. Sure there is. You can build a custom conf dir and point it to that. You *always* have that option for client settable options as a work around for lack of features/bugs.

Re: set reduced block size for a specific file

2011-08-27 Thread Ted Dunning
There is no way to do this for standard Apache Hadoop. But other, otherwise Hadoop compatible, systems such as MapR do support this operation. Rather than push commercial systems on this mailing list, I would simply recommend anybody who is curious to email me. On Sat, Aug 27, 2011 at 12:07 PM,

Re: set reduced block size for a specific file

2011-08-27 Thread Uma Maheswara Rao G 72686
Hi Ben, Currently there is no way to specify the blocksize from command line in Hadoop. Why can't you write the file from java program? Is there any use case for you to write some files only from command line? Regards, Uma - Original Message - From: Ben Clay Date: Saturday, August 27, 2