Re: Open call to be incl on Mesos support and services list

2014-07-25 Thread Paul Otto
Hi Dave, I would be interested in having Otto Ops LLC be added to that list. We have been building a Mesos + Marathon + Docker infrastructure for Time Warner Cable, and would be very interested in doing more with the community. Regards, Paul Otto -- Paul Otto Principal DevOps Engineer, Owner

Does Mesos support Hadoop MR V2

2014-07-25 Thread Luyi Wang
Checked the mesos github(https://github.com/mesos/hadoop). It listed support for MapReduce V1 How about the MR V2? Right now we are using cloudera to manage hadoop clusters where uses MRV2. We are planning to migrate all our services to mesos(still in the initial investigating stage). Good

Re: Does Mesos support Hadoop MR V2

2014-07-25 Thread Tom Arnfeld
Hey Luyi, That's correct, the Hadoop framework currently only supports Hadoop 2 MRv1. It also doesn't have great support for the HA jobtracker available in newer versions of Hadoop, but I've been working on that the past few weeks. I'm not sure how Hadoop 2 would play with Mesos, but very

Re: Does Mesos support Hadoop MR V2

2014-07-25 Thread Luyi Wang
Hey Tom: Really nice to get your reply. I am also looking forward that. If your progress can be shared, that would be great. I will also look into this. Will report back if I got any progress. Thanks a lot! -Luyi. On Fri, Jul 25, 2014 at 11:54 AM, Tom Arnfeld t...@duedil.com wrote:

Re: Does Mesos support Hadoop MR V2

2014-07-25 Thread Tom Arnfeld
I've not seen any issues pertaining to running many short lived frameworks, but that's not near the number of frameworks you'd see if each job was a framework. We've been pushing all our work on MRv1 High Availability JT upstream on the github.com/mesos/hadoop repo, though there hasn't been much

7/24 #MesosCon program committee notes

2014-07-25 Thread Dave Lester
Hi All, Below are notes from yesterday's #MesosCon program committee meeting. Dave 07/24/2014 *Attendees* Dave Lester, Isabel Jimenez, Matt Trifiro *Attendee/Registration Update* Revised from what was discussed during the 7/24 meeting: as of today (July 25), there are 187 total MesosCon

Re: cgroups OOM handler causing lockups?

2014-07-25 Thread Whitney Sorenson
Following up on this issue. After setting up a test cluster running many parallel VMs and cgroups OOMs we were able to isolate at least one current issue: https://bugzilla.kernel.org/show_bug.cgi?id=80881 We've also noticed a separate deadlock issue occurring in 3.10 which does not appear to be