To further complicate the issue the log file in (/var/log/hadoop-0.20-mapreduce/hadoop-hadoop-jobtracker-devUbuntu05.log) is owned by mapred:mapred and the name of the file seems to indicate some other lineage (hadoop,hadoop). I am out of my league in understanding the permission structure for hadoop hdfs and mr. Ideas?
From: Kevin Burton [mailto:[email protected]] Sent: Tuesday, April 30, 2013 8:31 AM To: [email protected] Cc: 'Mohammad Tariq' Subject: RE: Permission problem That is what I perceive as the problem. The hdfs file system was created with the user 'hdfs' owning the root ('/') but for some reason with a M/R job the user 'mapred' needs to have write permission to the root. I don't know how to satisfy both conditions. That is one reason that I relaxed the permission to 775 so that the group would also have write permission but that didn't seem to help. From: Mohammad Tariq [mailto:[email protected]] Sent: Tuesday, April 30, 2013 8:20 AM To: Kevin Burton Subject: Re: Permission problem user?"ls" shows "hdfs" and the log says "mapred".. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com On Tue, Apr 30, 2013 at 6:22 PM, Kevin Burton <[email protected]> wrote: I have relaxed it even further so now it is 775 kevin@devUbuntu05:/var/log/hadoop-0.20-mapreduce$ hadoop fs -ls -d / Found 1 items drwxrwxr-x - hdfs supergroup 0 2013-04-29 15:43 / But I still get this error: 2013-04-30 07:43:02,520 FATAL org.apache.hadoop.mapred.JobTracker: org.apache.hadoop.security.AccessControlException: Permission denied: user=mapred, access=WRITE, inode="/":hdfs:supergroup:drwxrwxr-x From: Mohammad Tariq [mailto:[email protected]] Sent: Monday, April 29, 2013 5:10 PM To: [email protected] Subject: Re: Incompartible cluserIDS make it 755. Warm Regards, Tariq https://mtariq.jux.com/ cloudfront.blogspot.com
