Yes at the moment it's easier to use the Hadoop version shipped with CDH3 in order to have durability (the other option being compiling the 0.20-append hadoop branch, which isn't so hard but then again I'm a committer so my opinion is biased).
At StumbleUpon we use CDH3b2 that we patched a bit, and it serves us very well. I have only good things to say about the people at Cloudera. J-D On Thu, Mar 17, 2011 at 4:47 PM, Geoff Hendrey <[email protected]> wrote: > Yep. I appreciate the info. Thanks. I wish I didn't have to use CDH, but > I was basically advised on this list that upgrading to CDH3 was a good > option (if not my best bet) to prevent the "data loss" that the HBase > admin page warns about. > > -geoff > > -----Original Message----- > From: [email protected] [mailto:[email protected]] On Behalf Of > Jean-Daniel Cryans > Sent: Thursday, March 17, 2011 4:14 PM > To: [email protected] > Subject: Re: CDH3B4 "fixes" permissions > > We tolerate some level of discussion regarding CDH when the issues > look more generic to HBase, like "I use CDH3b4 and the master has this > issue". The HBase version they ship isn't patched a lot, so an HBase > issue in CDH is mostly likely a real issue. > > In your case the question is at the HDFS level and concerns security > which isn't in any apache release yet, so it's "special" to cloudera. > > Also you have better chances to get answers from cloudera people on > their own lists :) > > Hope that helps, > > J-D > > On Thu, Mar 17, 2011 at 4:08 PM, Geoff Hendrey <[email protected]> > wrote: >> Fair. I've seen discussion of CDH3 on this list which is why I pinged. >> Is it bad form to discuss CDH3 here? >> >> -geoff >> >> -----Original Message----- >> From: [email protected] [mailto:[email protected]] On Behalf Of >> Jean-Daniel Cryans >> Sent: Thursday, March 17, 2011 4:05 PM >> To: [email protected] >> Subject: Re: CDH3B4 "fixes" permissions >> >> Good question, you might want to ask that to cloudera. >> >> J-D >> >> On Thu, Mar 17, 2011 at 4:00 PM, Geoff Hendrey <[email protected]> >> wrote: >>> Hi - >>> >>> >>> >>> I just upgraded to CDH3B4. I noticed when I ran 'hadoop dfsadmin >>> -upgrade' that the logs on the datanodes showed that hadoop was >> "fixing" >>> the permissions of my dfs storage disks to "rwx------". I am just >>> wondering why it does this? I had been using a subdirectory of one of >>> the disks for hadoop.tmp.dir, and of course now the hadoop.tmp.dir >>> cannot be written. >>> >>> >>> >>> -geoff >>> >>> >> >
