Hadoop with SELinux?

2010-01-05 Thread Gibbon, Robert, VF-Group
Hello list Can someone please tell me if it would be possible to run hadoop with SELinux enabled across the cluster? Are there any known issues or better, how2's I can be pointed at? Also interested in running iptables on the nodes - easy to do? Many thanks in advance Robert Robert Gibbon

Re: Hadoop with SELinux?

2010-01-05 Thread Michael Thomas
We have used selinux on our large cluster with HDFS (we don't use MR). The only issue I've found is that the mount program does not have permission to execute java, which prohibits you from mounting the fuse filesystem from /etc/fstab. This is fixed with the policy file below. require {

heck if I'm subscribed to this list

2010-01-05 Thread psdc1978
Hi, It's just to check if I'm subscribed to this list, because I posted some questions and I haven't got yet a response. -- Pedro

0.20.2 HDFS incompatible with 0.20.1

2010-01-05 Thread Todd Lipcon
Hey all, In a recent discussion, we noticed that the 0.20.2 HDFS client will not be wire-compatible with 0.20.0 or 0.20.1 due to the inclusion of HDFS-793 (required for HDFS-101). This begs a few questions: 1) Although we certainly do not guarantee wire compatibility between minor versions (0.20

Re: 0.20.2 HDFS incompatible with 0.20.1

2010-01-05 Thread Allen Wittenauer
On 1/5/10 11:29 AM, Todd Lipcon t...@cloudera.com wrote: 1) Although we certainly do not guarantee wire compatibility between minor versions (0.20 - 0.21) have we previously implied wire compatibility between bugfix releases? IIRC, it has been implied and was a goal but not officially written

Hadoop User Group (Bay Area) - Jan 20th at Yahoo!

2010-01-05 Thread Dekel Tankel
Hi all, Happy new year! RSVP is now open for the first 2010 Bay Area Hadoop user group at the Yahoo! Sunnyvale Campus, planed for Jan 20th. Registration is available here http://www.meetup.com/hadoop/calendar/12229988/ Agenda will be posted soon. Looking forward to seeing you there Dekel

Re: Which Hadoop product is more appropriate for a quick query on a large data set?

2010-01-05 Thread Xueling Shu
Hi Todd: After finishing some tasks I finally get back to HDFS testing. One question for your last reply to this thread: Are there any code examples close to your second and third recommendations? Or what APIs I should start with for my testing? Thanks. Xueling On Sat, Dec 12, 2009 at 1:01 PM,

Re: Three questions about Hadoop

2010-01-05 Thread Andrew Wang
Hi Annie, 2010/1/5 qin.wang qin.w...@i-soft.com.cn Hi team, When I try to do some research on Hadoop, I have several high level questions, if any comments from you it will do great help for me: 1. Hadoop assumes the files are big files, but take Google as an example, it seems the