Tom, do I understand correctly that with these scripts I can use the Apache Hadoop configuration as I am used to, and run and EC2 image that contains Cloudera Hadoop distribution?
PS. I could not download them from here, http://issues.apache.org/jira/secure/attachment/12422889/HADOOP-6108.patch, was getting, "too many open files" error. Thank you, Mark On Sun, Nov 15, 2009 at 10:29 PM, Tom White <[email protected]> wrote: > Hi Mark, > > HADOOP-6108 will add Cloudera's EC2 scripts to the Apache > distribution, with the difference that they will run Apache Hadoop. > The same scripts will also support Cloudera's Distribution for Hadoop, > simply by using a different boot script on the instances. So I would > suggest you use these scripts since they are more flexible than the > existing bash-based ones in Apache (e.g. they also support EBS), and > are likely to have more features added, and support more cloud > providers over time. > > Hope this helps. > > Tom > > On Sun, Nov 15, 2009 at 7:31 PM, Mark Kerzner <[email protected]> > wrote: > > Hi, guys, > > > > sorry for kind of making you do my work, but I have a conundrum. I have > been > > developing on Ubuntu, and preferred to run the same Ubuntu Linux on EC2, > and > > indeed, that is what Amazon Elastic MR was giving me. > > > > But now I am running my own cluster on EC2, and Apache Hadoop images are > all > > on Fedora. I have already figured out the scripts and it all works - > except > > that I have not tested on Fedora, and I do use Linux packages. > > > > Alternatively, I could run on Cloudera's Hadoop, and they have Ubuntu. > But, > > I would probably to switch to their distribution in my code, and learn > their > > startup scripts. > > > > Which way is better? > > > > Thank you, > > Mark > > >
