Hi! Thinking a little more deeply this YARN feature (Hadoop YARN Service framework) could affect Apache Myriad regarding new development goals. Apache Myriad based on YARN 3.x could be a possible substitute for general purpose meta-scheduling Mesos frameworks such as Marathon or Apache Aurora. We can rewrite the Myriad UI in order to allow run YARN native applications, Docker containers or regular applications.
It's just a crazy idea: DC/OS + Apache Myriad (natively installed as systemd unit) instead of Marathon, working as meta-scheduler for Mesos. What do you think? -- Javi Roman Twitter: @javiromanrh GitHub: github.com/javiroman Linkedin: es.linkedin.com/in/javiroman Big Data Blog: dataintensive.info On Mon, Apr 23, 2018 at 8:02 AM, Javi Roman <jroman.espi...@gmail.com> wrote: > Hi Darin, > > You are right Slider is a kind of framework for long running > applications into YARN, and it's a way of running applications on YARN > without changing the application code, there is no need to develop a > custom Application Master or other YARN code. Apparently you can run > unmodified applications on YARN via Slider. > > This shift towards Hadoop code (instead of separate project, incubator > slider) doesn't affect Myriad at all. However I was thinking any kind > of collaboration with Slider project, and this collaboration is > unclear right now, because of fuzzy continuity of Slider. > -- > Javi Roman > > Twitter: @javiromanrh > GitHub: github.com/javiroman > Linkedin: es.linkedin.com/in/javiroman > Big Data Blog: dataintensive.info > > > On Mon, Apr 23, 2018 at 1:25 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: >> Javi can you explain how this effects myriad? My understanding is that >> slider is similar to marathon but for yarn. >> >> On Sat, Apr 21, 2018, 2:23 AM Javi Roman <jroman.espi...@gmail.com> wrote: >> >>> FYI >>> >>> Regarding the recent conversation about YARN applications development >>> via Apache Slider, as a different approach for creating data services >>> applications on Apache Mesos (via Myriad,) "article 4" here [1], will >>> probably have to wait until the resolution of this discussion at >>> Apache Slider list [2]. Basically the Slider community is discussing >>> about the retirement of the project, because the Slider core is being >>> included in Hadoop 3 [3]. >>> >>> [1] https://goo.gl/RVkFUF >>> [2] https://goo.gl/CPR2TF >>> [3] https://issues.apache.org/jira/browse/YARN-5079 >>> >>> -- >>> Javi Roman >>> >>> Twitter: @javiromanrh >>> GitHub: github.com/javiroman >>> Linkedin: es.linkedin.com/in/javiroman >>> Big Data Blog: dataintensive.info >>>
