Re: Apache Slider and Apache Myriad

+1 > On Apr 24, 2018, at 11:41 AM, Brandon Gulla wrote: > > Possible, maybe, the right thing to do? Probably not. > > There are multiple container orchestration platforms these days, and the > pecking order is k8s -> mesos -> yarn. DC/OS has already implemented >

Re: Apache Slider and Apache Myriad

Possible, maybe, the right thing to do? Probably not. There are multiple container orchestration platforms these days, and the pecking order is k8s -> mesos -> yarn. DC/OS has already implemented support for kubernetes, but purely because it is seeing k8s as a competitor and Mesosphere desires to

Re: Apache Slider and Apache Myriad

Probably you are right, however thinking that we have Apache Mesos as coarse-grained scheduling, and generally we run at least one fine-grained "general purpose" or "meta-scheduler" such as Marathon, Aurora or even Kubernetes as framework. Why not apply the same rationale for Myriad, YARN as

Re: Apache Slider and Apache Myriad

Are you suggesting using Myriad as meta-scheduler for Mesos? If yes, then:1. Why would one need Mesos or Myriad at all - use YARN for everything?2. Mesos scheduler is much more robust then YARN scheduler as it's based on the offers - it was done having multiple subsystems in mind unlike YARN

Re: Apache Slider and Apache Myriad

Hi! Thinking a little more deeply this YARN feature (Hadoop YARN Service framework) could affect Apache Myriad regarding new development goals. Apache Myriad based on YARN 3.x could be a possible substitute for general purpose meta-scheduling Mesos frameworks such as Marathon or Apache Aurora.

Re: Apache Slider and Apache Myriad

Hi Darin, You are right Slider is a kind of framework for long running applications into YARN, and it's a way of running applications on YARN without changing the application code, there is no need to develop a custom Application Master or other YARN code. Apparently you can run unmodified

Apache Slider and Apache Myriad

FYI Regarding the recent conversation about YARN applications development via Apache Slider, as a different approach for creating data services applications on Apache Mesos (via Myriad,) "article 4" here [1], will probably have to wait until the resolution of this discussion at Apache Slider list