Re: Running Hadoop MRv2 on Mesos

2013-12-06 Thread Tim St Clair
Aaron - You might want to follow up on a thread from July, but I don't know if anything has happened. http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-dev/201307.mbox/%3CCAAD07OLom2SUHBwHKmpQ0YNsQtQTAM9-4igcui%2BrjkJz3XN7jQ%40mail.gmail.com%3E However, imho Spark is now mature enou

Re: Running Hadoop MRv2 on Mesos

2013-12-06 Thread Paco Nathan
+1 On Fri, Dec 6, 2013 at 11:19 AM, Vinod Kone wrote: > I am unaware of any ongoing efforts related to this though this request > came up a few times before. Maybe we could do this in our next (whenever it > happens to be) Mesos hackathon! > > > On Fri, Dec 6, 2013 at 11:46 PM, Aaron Gottlieb

Re: Running Hadoop MRv2 on Mesos

2013-12-06 Thread Vinod Kone
I am unaware of any ongoing efforts related to this though this request came up a few times before. Maybe we could do this in our next (whenever it happens to be) Mesos hackathon! On Fri, Dec 6, 2013 at 11:46 PM, Aaron Gottlieb wrote: > Hi, > > > > I was wondering if there is any current work/s

Running Hadoop MRv2 on Mesos

2013-12-06 Thread Aaron Gottlieb
Hi, I was wondering if there is any current work/support for running Hadoop MRv2 on a Mesos Cluster. I do not mean running YARN, but running what the old JobTracker and TaskTrackers have become: MRAppMaster and its containers. Mesos uses a pluggable scheduler to work with the Hadoop MRv1 JobTr