Re: How to deploy Hadoop on Mesos

Hadoop definitely seems to be on the list of frameworks for mesos: http://mesos.apache.org/documentation/latest/frameworks/ Has anyone recently tested getting it to work? On Thu, Jul 27, 2017 at 5:39 PM, Stephen Gran wrote: > Hi, > > On 27/07/17 13:54, Traiano

Re: How to deploy Hadoop on Mesos

Hi, On 27/07/17 13:54, Traiano Welcome wrote: > Hi Stephen > > > On Thu, Jul 27, 2017 at 12:19 PM, Stephen Gran > wrote: > Both spark and flink integrate natively with mesos, so no need for an > intermediate yarn layer. For batch work, we're looking at the

Re: How to deploy Hadoop on Mesos

Hi Stephen On Thu, Jul 27, 2017 at 12:19 PM, Stephen Gran wrote: > Hi, > > So typically people run two sorts of workloads on hadoop - > ad-hoc/scheduled batch work, and stream workloads (spark, flink, etc.). > > I'm definitely sure we'll be using hadoop for batch

Re: How to deploy Hadoop on Mesos

Hi, So typically people run two sorts of workloads on hadoop - ad-hoc/scheduled batch work, and stream workloads (spark, flink, etc.). Both spark and flink integrate natively with mesos, so no need for an intermediate yarn layer. For batch work, we're looking at the aurora project for job

Re: How to deploy Hadoop on Mesos

Hi Brandon On Wed, Jul 26, 2017 at 5:13 PM, Brandon Gulla wrote: > Have you looked into Apache Myriad? > > http://myriad.apache.org/ > I took a brief look and thought "more flaky, half-cooked stuff that doesn't work in production and will cause a system engineer a

Re: How to deploy Hadoop on Mesos

Hi Stephen On Wed, Jul 26, 2017 at 5:18 PM, Stephen Gran wrote: > Hi, > > It is having discussions about whether to stop, as it's having trouble > getting enough contributors. > > I guess I'd ask what you need to run on hadoop, why you're looking at > mesos, and then

Re: How to deploy Hadoop on Mesos

Hi, It is having discussions about whether to stop, as it's having trouble getting enough contributors. I guess I'd ask what you need to run on hadoop, why you're looking at mesos, and then see what else is in that space. Cheers, On 26/07/17 14:13, Brandon Gulla wrote: > Have you looked into

Re: How to deploy Hadoop on Mesos

Have you looked into Apache Myriad? http://myriad.apache.org/ On Wed, Jul 26, 2017 at 4:12 AM, Traiano Welcome wrote: > Hi > > Would anyone know of some reliable guides to deploying apache hadoop on > top of the mesos scheduler? > > Thanks, > Traiano > -- Brandon