Re: Apache Slider and Apache Myriad

2018-04-24 Thread Yuliya
+1 > On Apr 24, 2018, at 11:41 AM, Brandon Gulla wrote: > > Possible, maybe, the right thing to do? Probably not. > > There are multiple container orchestration platforms these days, and the > pecking order is k8s -> mesos -> yarn. DC/OS has already implemented > support for kubernetes, but pur

Re: Apache Slider and Apache Myriad

2018-04-24 Thread Brandon Gulla
Possible, maybe, the right thing to do? Probably not. There are multiple container orchestration platforms these days, and the pecking order is k8s -> mesos -> yarn. DC/OS has already implemented support for kubernetes, but purely because it is seeing k8s as a competitor and Mesosphere desires to

Re: Apache Slider and Apache Myriad

2018-04-24 Thread Javi Roman
Probably you are right, however thinking that we have Apache Mesos as coarse-grained scheduling, and generally we run at least one fine-grained "general purpose" or "meta-scheduler" such as Marathon, Aurora or even Kubernetes as framework. Why not apply the same rationale for Myriad, YARN as genera

Re: Apache Slider and Apache Myriad

2018-04-24 Thread yuliya Feldman
Are you suggesting using Myriad as meta-scheduler for Mesos? If yes, then:1. Why would one need Mesos or Myriad at all - use YARN for everything?2. Mesos scheduler is much more robust then YARN scheduler as it's based on the offers - it was done having multiple subsystems in mind unlike YARN AFA

Re: Apache Slider and Apache Myriad

2018-04-24 Thread Javi Roman
Hi! Thinking a little more deeply this YARN feature (Hadoop YARN Service framework) could affect Apache Myriad regarding new development goals. Apache Myriad based on YARN 3.x could be a possible substitute for general purpose meta-scheduling Mesos frameworks such as Marathon or Apache Aurora. We

Re: Apache Slider and Apache Myriad

2018-04-22 Thread Javi Roman
Hi Darin, You are right Slider is a kind of framework for long running applications into YARN, and it's a way of running applications on YARN without changing the application code, there is no need to develop a custom Application Master or other YARN code. Apparently you can run unmodified applica

Re: Apache Slider and Apache Myriad

2018-04-22 Thread Darin Johnson
Javi can you explain how this effects myriad? My understanding is that slider is similar to marathon but for yarn. On Sat, Apr 21, 2018, 2:23 AM Javi Roman wrote: > FYI > > Regarding the recent conversation about YARN applications development > via Apache Slider, as a different approach for cre

Apache Slider and Apache Myriad

2018-04-20 Thread Javi Roman
FYI Regarding the recent conversation about YARN applications development via Apache Slider, as a different approach for creating data services applications on Apache Mesos (via Myriad,) "article 4" here [1], will probably have to wait until the resolution of this discussion at Apache Slider list