Re: Understanding Myriad workflows
Hi all, https://cwiki.apache.org/confluence/display/MYRIAD/Administration I see that there is a mention of Marathon in this document - I'm not sure where in the Myriad workflow marathon is being used - can anyone help me understand this better - or if I'm missing something ? On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harriswrote: > hi Haripriya, > > No problem. Let me know if you see any errors or inconsistencies. > > Regards, --ruth > > Ruth Harris > Sr. Tech. Writer, MapR > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula < > aharipriy...@gmail.com> wrote: > > > Thanks Ruth! That was helpful! > > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris > wrote: > > > > > The REST API is documented in the Apache wiki: > > > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API > > > > > > Also, in progress, documentation on fine-grained scaling: > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling > > > > > > --ruth > > > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula < > > > aharipriy...@gmail.com> wrote: > > > > > > > Hi, > > > > > > > > Is there any architecture document describing the basic workflows - > on > > > flex > > > > up the methods called etc? I'm going through the source code on git > hub > > > and > > > > was wondering if there is any such source which would help me > > understand > > > > the internals more.. > > > > > > > > -- > > > > Regards, > > > > Haripriya Ayyalasomayajula > > > > > > > > > > > > > > > > -- > > > Ruth Harris > > > Sr. Technical Writer, MapR > > > > > > > > > > > -- > > Regards, > > Haripriya Ayyalasomayajula > > > > > > -- > Ruth Harris > Sr. Technical Writer, MapR > -- Regards, Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Hi Adam, Thanks. I was aware of the possibility of starting RM using Marathon - thats for clarifying. I was wondering if any of the Myriad implementation is based on that of Marathon.. On Mon, Sep 21, 2015 at 10:08 AM, Adam Bordelonwrote: > Haripriya, > > You may want to use something like Marathon to start the RM/scheduler and > keep it up, so that Marathon can restart it somewhere else if the RM > app/process, or even its entire machine fails. You can, of course, start > the RM/scheduler manually on a node, but you'll have to manage its HA on > your own. > > On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula < > aharipriy...@gmail.com> wrote: > > > Hi all, > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Administration > > > > I see that there is a mention of Marathon in this document - I'm not sure > > where in the Myriad workflow marathon is being used - can anyone help me > > understand this better - or if I'm missing something ? > > > > On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris > > wrote: > > > > > hi Haripriya, > > > > > > No problem. Let me know if you see any errors or inconsistencies. > > > > > > Regards, --ruth > > > > > > Ruth Harris > > > Sr. Tech. Writer, MapR > > > > > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula < > > > aharipriy...@gmail.com> wrote: > > > > > > > Thanks Ruth! That was helpful! > > > > > > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris > > > wrote: > > > > > > > > > The REST API is documented in the Apache wiki: > > > > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API > > > > > > > > > > Also, in progress, documentation on fine-grained scaling: > > > > > > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling > > > > > > > > > > --ruth > > > > > > > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula < > > > > > aharipriy...@gmail.com> wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > Is there any architecture document describing the basic > workflows - > > > on > > > > > flex > > > > > > up the methods called etc? I'm going through the source code on > git > > > hub > > > > > and > > > > > > was wondering if there is any such source which would help me > > > > understand > > > > > > the internals more.. > > > > > > > > > > > > -- > > > > > > Regards, > > > > > > Haripriya Ayyalasomayajula > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Ruth Harris > > > > > Sr. Technical Writer, MapR > > > > > > > > > > > > > > > > > > > > > -- > > > > Regards, > > > > Haripriya Ayyalasomayajula > > > > > > > > > > > > > > > > -- > > > Ruth Harris > > > Sr. Technical Writer, MapR > > > > > > > > > > > -- > > Regards, > > Haripriya Ayyalasomayajula > > > -- Regards, Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Myriad implementation does not depend on Marathon, so you don't need to start MyraidScheduler/RM using Marathon. In this case you need to take care of MyriadScheduler/RM restart in case of it's failure yourself. Myriad HA feature will take care of preserving state, but restart and discoverability will be in your hands. Thanks,Yuliya From: Haripriya Ayyalasomayajula <aharipriy...@gmail.com> To: dev@myriad.incubator.apache.org Sent: Monday, September 21, 2015 10:19 AM Subject: Re: Understanding Myriad workflows Hi Adam, Thanks. I was aware of the possibility of starting RM using Marathon - thats for clarifying. I was wondering if any of the Myriad implementation is based on that of Marathon.. On Mon, Sep 21, 2015 at 10:08 AM, Adam Bordelon <a...@mesosphere.io> wrote: > Haripriya, > > You may want to use something like Marathon to start the RM/scheduler and > keep it up, so that Marathon can restart it somewhere else if the RM > app/process, or even its entire machine fails. You can, of course, start > the RM/scheduler manually on a node, but you'll have to manage its HA on > your own. > > On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula < > aharipriy...@gmail.com> wrote: > > > Hi all, > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Administration > > > > I see that there is a mention of Marathon in this document - I'm not sure > > where in the Myriad workflow marathon is being used - can anyone help me > > understand this better - or if I'm missing something ? > > > > On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris <rhar...@maprtech.com> > > wrote: > > > > > hi Haripriya, > > > > > > No problem. Let me know if you see any errors or inconsistencies. > > > > > > Regards, --ruth > > > > > > Ruth Harris > > > Sr. Tech. Writer, MapR > > > > > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula < > > > aharipriy...@gmail.com> wrote: > > > > > > > Thanks Ruth! That was helpful! > > > > > > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rhar...@maprtech.com> > > > wrote: > > > > > > > > > The REST API is documented in the Apache wiki: > > > > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API > > > > > > > > > > Also, in progress, documentation on fine-grained scaling: > > > > > > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling > > > > > > > > > > --ruth > > > > > > > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula < > > > > > aharipriy...@gmail.com> wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > Is there any architecture document describing the basic > workflows - > > > on > > > > > flex > > > > > > up the methods called etc? I'm going through the source code on > git > > > hub > > > > > and > > > > > > was wondering if there is any such source which would help me > > > > understand > > > > > > the internals more.. > > > > > > > > > > > > -- > > > > > > Regards, > > > > > > Haripriya Ayyalasomayajula > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > Ruth Harris > > > > > Sr. Technical Writer, MapR > > > > > > > > > > > > > > > > > > > > > -- > > > > Regards, > > > > Haripriya Ayyalasomayajula > > > > > > > > > > > > > > > > -- > > > Ruth Harris > > > Sr. Technical Writer, MapR > > > > > > > > > > > -- > > Regards, > > Haripriya Ayyalasomayajula > > > -- Regards, Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
Haripriya, You may want to use something like Marathon to start the RM/scheduler and keep it up, so that Marathon can restart it somewhere else if the RM app/process, or even its entire machine fails. You can, of course, start the RM/scheduler manually on a node, but you'll have to manage its HA on your own. On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula < aharipriy...@gmail.com> wrote: > Hi all, > > https://cwiki.apache.org/confluence/display/MYRIAD/Administration > > I see that there is a mention of Marathon in this document - I'm not sure > where in the Myriad workflow marathon is being used - can anyone help me > understand this better - or if I'm missing something ? > > On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris> wrote: > > > hi Haripriya, > > > > No problem. Let me know if you see any errors or inconsistencies. > > > > Regards, --ruth > > > > Ruth Harris > > Sr. Tech. Writer, MapR > > > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula < > > aharipriy...@gmail.com> wrote: > > > > > Thanks Ruth! That was helpful! > > > > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris > > wrote: > > > > > > > The REST API is documented in the Apache wiki: > > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API > > > > > > > > Also, in progress, documentation on fine-grained scaling: > > > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling > > > > > > > > --ruth > > > > > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula < > > > > aharipriy...@gmail.com> wrote: > > > > > > > > > Hi, > > > > > > > > > > Is there any architecture document describing the basic workflows - > > on > > > > flex > > > > > up the methods called etc? I'm going through the source code on git > > hub > > > > and > > > > > was wondering if there is any such source which would help me > > > understand > > > > > the internals more.. > > > > > > > > > > -- > > > > > Regards, > > > > > Haripriya Ayyalasomayajula > > > > > > > > > > > > > > > > > > > > > -- > > > > Ruth Harris > > > > Sr. Technical Writer, MapR > > > > > > > > > > > > > > > > -- > > > Regards, > > > Haripriya Ayyalasomayajula > > > > > > > > > > > -- > > Ruth Harris > > Sr. Technical Writer, MapR > > > > > > -- > Regards, > Haripriya Ayyalasomayajula >
Re: Understanding Myriad workflows
Thanks Ruth! That was helpful! On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harriswrote: > The REST API is documented in the Apache wiki: > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API > > Also, in progress, documentation on fine-grained scaling: > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling > > --ruth > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula < > aharipriy...@gmail.com> wrote: > > > Hi, > > > > Is there any architecture document describing the basic workflows - on > flex > > up the methods called etc? I'm going through the source code on git hub > and > > was wondering if there is any such source which would help me understand > > the internals more.. > > > > -- > > Regards, > > Haripriya Ayyalasomayajula > > > > > > -- > Ruth Harris > Sr. Technical Writer, MapR > -- Regards, Haripriya Ayyalasomayajula
Re: Understanding Myriad workflows
hi Haripriya, No problem. Let me know if you see any errors or inconsistencies. Regards, --ruth Ruth Harris Sr. Tech. Writer, MapR On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula < aharipriy...@gmail.com> wrote: > Thanks Ruth! That was helpful! > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harriswrote: > > > The REST API is documented in the Apache wiki: > > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API > > > > Also, in progress, documentation on fine-grained scaling: > > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling > > > > --ruth > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula < > > aharipriy...@gmail.com> wrote: > > > > > Hi, > > > > > > Is there any architecture document describing the basic workflows - on > > flex > > > up the methods called etc? I'm going through the source code on git hub > > and > > > was wondering if there is any such source which would help me > understand > > > the internals more.. > > > > > > -- > > > Regards, > > > Haripriya Ayyalasomayajula > > > > > > > > > > > -- > > Ruth Harris > > Sr. Technical Writer, MapR > > > > > > -- > Regards, > Haripriya Ayyalasomayajula > -- Ruth Harris Sr. Technical Writer, MapR