Re: Understanding Myriad workflows

2015-09-21 Thread Haripriya Ayyalasomayajula
Hi all,

https://cwiki.apache.org/confluence/display/MYRIAD/Administration

I see that there is a mention of Marathon in this document - I'm not sure
where in the Myriad workflow marathon is being used - can anyone help me
understand this better - or if I'm missing something ?

On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris  wrote:

> hi Haripriya,
>
> No problem. Let me know if you see any errors or inconsistencies.
>
> Regards,  --ruth
>
> Ruth Harris
> Sr. Tech. Writer, MapR
>
> On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> aharipriy...@gmail.com> wrote:
>
> > Thanks Ruth! That was helpful!
> >
> > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris 
> wrote:
> >
> > > The REST API is documented in the Apache wiki:
> > > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > >
> > > Also, in progress, documentation on fine-grained scaling:
> > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > >
> > > --ruth
> > >
> > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > aharipriy...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > Is there any architecture document describing the basic workflows -
> on
> > > flex
> > > > up the methods called etc? I'm going through the source code on git
> hub
> > > and
> > > > was wondering if there is any such source which would help me
> > understand
> > > > the internals more..
> > > >
> > > > --
> > > > Regards,
> > > > Haripriya Ayyalasomayajula
> > > >
> > >
> > >
> > >
> > > --
> > > Ruth Harris
> > > Sr. Technical Writer, MapR
> > >
> >
> >
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>
>
>
> --
> Ruth Harris
> Sr. Technical Writer, MapR
>



-- 
Regards,
Haripriya Ayyalasomayajula


Re: Understanding Myriad workflows

2015-09-21 Thread Haripriya Ayyalasomayajula
Hi Adam,

Thanks. I was aware of the possibility of starting RM using Marathon -
thats for clarifying. I was wondering if any of the Myriad implementation
is based on that of Marathon..

On Mon, Sep 21, 2015 at 10:08 AM, Adam Bordelon  wrote:

> Haripriya,
>
> You may want to use something like Marathon to start the RM/scheduler and
> keep it up, so that Marathon can restart it somewhere else if the RM
> app/process, or even its entire machine fails. You can, of course, start
> the RM/scheduler manually on a node, but you'll have to manage its HA on
> your own.
>
> On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula <
> aharipriy...@gmail.com> wrote:
>
> > Hi all,
> >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Administration
> >
> > I see that there is a mention of Marathon in this document - I'm not sure
> > where in the Myriad workflow marathon is being used - can anyone help me
> > understand this better - or if I'm missing something ?
> >
> > On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris 
> > wrote:
> >
> > > hi Haripriya,
> > >
> > > No problem. Let me know if you see any errors or inconsistencies.
> > >
> > > Regards,  --ruth
> > >
> > > Ruth Harris
> > > Sr. Tech. Writer, MapR
> > >
> > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> > > aharipriy...@gmail.com> wrote:
> > >
> > > > Thanks Ruth! That was helpful!
> > > >
> > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris 
> > > wrote:
> > > >
> > > > > The REST API is documented in the Apache wiki:
> > > > >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > > > >
> > > > > Also, in progress, documentation on fine-grained scaling:
> > > > >
> > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > > > >
> > > > > --ruth
> > > > >
> > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > > > aharipriy...@gmail.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > Is there any architecture document describing the basic
> workflows -
> > > on
> > > > > flex
> > > > > > up the methods called etc? I'm going through the source code on
> git
> > > hub
> > > > > and
> > > > > > was wondering if there is any such source which would help me
> > > > understand
> > > > > > the internals more..
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > Haripriya Ayyalasomayajula
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Ruth Harris
> > > > > Sr. Technical Writer, MapR
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Regards,
> > > > Haripriya Ayyalasomayajula
> > > >
> > >
> > >
> > >
> > > --
> > > Ruth Harris
> > > Sr. Technical Writer, MapR
> > >
> >
> >
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>



-- 
Regards,
Haripriya Ayyalasomayajula


Re: Understanding Myriad workflows

2015-09-21 Thread yuliya Feldman
Myriad implementation does not depend on Marathon, so you don't need to start 
MyraidScheduler/RM using Marathon.
In this case you need to take care of MyriadScheduler/RM restart in case of 
it's failure yourself.
Myriad HA feature will take care of preserving state, but restart and 
discoverability will be in your hands.
Thanks,Yuliya 
  From: Haripriya Ayyalasomayajula <aharipriy...@gmail.com>
 To: dev@myriad.incubator.apache.org 
 Sent: Monday, September 21, 2015 10:19 AM
 Subject: Re: Understanding Myriad workflows
   
Hi Adam,

Thanks. I was aware of the possibility of starting RM using Marathon -
thats for clarifying. I was wondering if any of the Myriad implementation
is based on that of Marathon..

On Mon, Sep 21, 2015 at 10:08 AM, Adam Bordelon <a...@mesosphere.io> wrote:

> Haripriya,
>
> You may want to use something like Marathon to start the RM/scheduler and
> keep it up, so that Marathon can restart it somewhere else if the RM
> app/process, or even its entire machine fails. You can, of course, start
> the RM/scheduler manually on a node, but you'll have to manage its HA on
> your own.
>
> On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula <
> aharipriy...@gmail.com> wrote:
>
> > Hi all,
> >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Administration
> >
> > I see that there is a mention of Marathon in this document - I'm not sure
> > where in the Myriad workflow marathon is being used - can anyone help me
> > understand this better - or if I'm missing something ?
> >
> > On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris <rhar...@maprtech.com>
> > wrote:
> >
> > > hi Haripriya,
> > >
> > > No problem. Let me know if you see any errors or inconsistencies.
> > >
> > > Regards,  --ruth
> > >
> > > Ruth Harris
> > > Sr. Tech. Writer, MapR
> > >
> > > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> > > aharipriy...@gmail.com> wrote:
> > >
> > > > Thanks Ruth! That was helpful!
> > > >
> > > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris <rhar...@maprtech.com>
> > > wrote:
> > > >
> > > > > The REST API is documented in the Apache wiki:
> > > > >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > > > >
> > > > > Also, in progress, documentation on fine-grained scaling:
> > > > >
> > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > > > >
> > > > > --ruth
> > > > >
> > > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > > > aharipriy...@gmail.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > Is there any architecture document describing the basic
> workflows -
> > > on
> > > > > flex
> > > > > > up the methods called etc? I'm going through the source code on
> git
> > > hub
> > > > > and
> > > > > > was wondering if there is any such source which would help me
> > > > understand
> > > > > > the internals more..
> > > > > >
> > > > > > --
> > > > > > Regards,
> > > > > > Haripriya Ayyalasomayajula
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Ruth Harris
> > > > > Sr. Technical Writer, MapR


> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Regards,
> > > > Haripriya Ayyalasomayajula
> > > >
> > >
> > >
> > >
> > > --
> > > Ruth Harris
> > > Sr. Technical Writer, MapR
> > >
> >
> >
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>



-- 
Regards,
Haripriya Ayyalasomayajula


  

Re: Understanding Myriad workflows

2015-09-21 Thread Adam Bordelon
Haripriya,

You may want to use something like Marathon to start the RM/scheduler and
keep it up, so that Marathon can restart it somewhere else if the RM
app/process, or even its entire machine fails. You can, of course, start
the RM/scheduler manually on a node, but you'll have to manage its HA on
your own.

On Mon, Sep 21, 2015 at 10:06 AM, Haripriya Ayyalasomayajula <
aharipriy...@gmail.com> wrote:

> Hi all,
>
> https://cwiki.apache.org/confluence/display/MYRIAD/Administration
>
> I see that there is a mention of Marathon in this document - I'm not sure
> where in the Myriad workflow marathon is being used - can anyone help me
> understand this better - or if I'm missing something ?
>
> On Wed, Sep 16, 2015 at 11:07 AM, Ruth Harris 
> wrote:
>
> > hi Haripriya,
> >
> > No problem. Let me know if you see any errors or inconsistencies.
> >
> > Regards,  --ruth
> >
> > Ruth Harris
> > Sr. Tech. Writer, MapR
> >
> > On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
> > aharipriy...@gmail.com> wrote:
> >
> > > Thanks Ruth! That was helpful!
> > >
> > > On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris 
> > wrote:
> > >
> > > > The REST API is documented in the Apache wiki:
> > > >
> https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> > > >
> > > > Also, in progress, documentation on fine-grained scaling:
> > > >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> > > >
> > > > --ruth
> > > >
> > > > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > > > aharipriy...@gmail.com> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > Is there any architecture document describing the basic workflows -
> > on
> > > > flex
> > > > > up the methods called etc? I'm going through the source code on git
> > hub
> > > > and
> > > > > was wondering if there is any such source which would help me
> > > understand
> > > > > the internals more..
> > > > >
> > > > > --
> > > > > Regards,
> > > > > Haripriya Ayyalasomayajula
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > > Ruth Harris
> > > > Sr. Technical Writer, MapR
> > > >
> > >
> > >
> > >
> > > --
> > > Regards,
> > > Haripriya Ayyalasomayajula
> > >
> >
> >
> >
> > --
> > Ruth Harris
> > Sr. Technical Writer, MapR
> >
>
>
>
> --
> Regards,
> Haripriya Ayyalasomayajula
>


Re: Understanding Myriad workflows

2015-09-16 Thread Haripriya Ayyalasomayajula
Thanks Ruth! That was helpful!

On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris  wrote:

> The REST API is documented in the Apache wiki:
> https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
>
> Also, in progress, documentation on fine-grained scaling:
> https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
>
> --ruth
>
> On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> aharipriy...@gmail.com> wrote:
>
> > Hi,
> >
> > Is there any architecture document describing the basic workflows - on
> flex
> > up the methods called etc? I'm going through the source code on git hub
> and
> > was wondering if there is any such source which would help me understand
> > the internals more..
> >
> > --
> > Regards,
> > Haripriya Ayyalasomayajula
> >
>
>
>
> --
> Ruth Harris
> Sr. Technical Writer, MapR
>



-- 
Regards,
Haripriya Ayyalasomayajula


Re: Understanding Myriad workflows

2015-09-16 Thread Ruth Harris
hi Haripriya,

No problem. Let me know if you see any errors or inconsistencies.

Regards,  --ruth

Ruth Harris
Sr. Tech. Writer, MapR

On Wed, Sep 16, 2015 at 9:44 AM, Haripriya Ayyalasomayajula <
aharipriy...@gmail.com> wrote:

> Thanks Ruth! That was helpful!
>
> On Mon, Sep 14, 2015 at 1:06 PM, Ruth Harris  wrote:
>
> > The REST API is documented in the Apache wiki:
> > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Cluster+API
> >
> > Also, in progress, documentation on fine-grained scaling:
> > https://cwiki.apache.org/confluence/display/MYRIAD/Fine-grained+Scaling
> >
> > --ruth
> >
> > On Mon, Sep 14, 2015 at 12:24 PM, Haripriya Ayyalasomayajula <
> > aharipriy...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Is there any architecture document describing the basic workflows - on
> > flex
> > > up the methods called etc? I'm going through the source code on git hub
> > and
> > > was wondering if there is any such source which would help me
> understand
> > > the internals more..
> > >
> > > --
> > > Regards,
> > > Haripriya Ayyalasomayajula
> > >
> >
> >
> >
> > --
> > Ruth Harris
> > Sr. Technical Writer, MapR
> >
>
>
>
> --
> Regards,
> Haripriya Ayyalasomayajula
>



-- 
Ruth Harris
Sr. Technical Writer, MapR