Aw, thanks JD :) Geoff, we'd be happy to help you over on the cdh-user list. Don't hesitate to email - there's a good reason it's fixing permissions like this.
Also, putting your tmp dir inside your data dir is not a good idea. Would definitely discourage that. -Todd On Thu, Mar 17, 2011 at 4:56 PM, Jean-Daniel Cryans <[email protected]> wrote: > Yes at the moment it's easier to use the Hadoop version shipped with > CDH3 in order to have durability (the other option being compiling the > 0.20-append hadoop branch, which isn't so hard but then again I'm a > committer so my opinion is biased). > > At StumbleUpon we use CDH3b2 that we patched a bit, and it serves us > very well. I have only good things to say about the people at > Cloudera. > > J-D > > On Thu, Mar 17, 2011 at 4:47 PM, Geoff Hendrey <[email protected]> wrote: >> Yep. I appreciate the info. Thanks. I wish I didn't have to use CDH, but >> I was basically advised on this list that upgrading to CDH3 was a good >> option (if not my best bet) to prevent the "data loss" that the HBase >> admin page warns about. >> >> -geoff >> >> -----Original Message----- >> From: [email protected] [mailto:[email protected]] On Behalf Of >> Jean-Daniel Cryans >> Sent: Thursday, March 17, 2011 4:14 PM >> To: [email protected] >> Subject: Re: CDH3B4 "fixes" permissions >> >> We tolerate some level of discussion regarding CDH when the issues >> look more generic to HBase, like "I use CDH3b4 and the master has this >> issue". The HBase version they ship isn't patched a lot, so an HBase >> issue in CDH is mostly likely a real issue. >> >> In your case the question is at the HDFS level and concerns security >> which isn't in any apache release yet, so it's "special" to cloudera. >> >> Also you have better chances to get answers from cloudera people on >> their own lists :) >> >> Hope that helps, >> >> J-D >> >> On Thu, Mar 17, 2011 at 4:08 PM, Geoff Hendrey <[email protected]> >> wrote: >>> Fair. I've seen discussion of CDH3 on this list which is why I pinged. >>> Is it bad form to discuss CDH3 here? >>> >>> -geoff >>> >>> -----Original Message----- >>> From: [email protected] [mailto:[email protected]] On Behalf Of >>> Jean-Daniel Cryans >>> Sent: Thursday, March 17, 2011 4:05 PM >>> To: [email protected] >>> Subject: Re: CDH3B4 "fixes" permissions >>> >>> Good question, you might want to ask that to cloudera. >>> >>> J-D >>> >>> On Thu, Mar 17, 2011 at 4:00 PM, Geoff Hendrey <[email protected]> >>> wrote: >>>> Hi - >>>> >>>> >>>> >>>> I just upgraded to CDH3B4. I noticed when I ran 'hadoop dfsadmin >>>> -upgrade' that the logs on the datanodes showed that hadoop was >>> "fixing" >>>> the permissions of my dfs storage disks to "rwx------". I am just >>>> wondering why it does this? I had been using a subdirectory of one of >>>> the disks for hadoop.tmp.dir, and of course now the hadoop.tmp.dir >>>> cannot be written. >>>> >>>> >>>> >>>> -geoff >>>> >>>> >>> >> > -- Todd Lipcon Software Engineer, Cloudera
