Re: Need inputs on running MPI jobs on Mesos

[Mangirish Wagle]

Hi Joseph,

Thanks for your response.
What I really want to know is, whether there are any particular reasons why
the community has not been supporting any work related to MPI on Mesos.
There has been some good demand for cloud based MPI support. Given the
known resource management capabilities of Mesos, we at Apache Airavata are
targeting a Mesos based schedular for MPI jobs for extending the
capabilities to cloud based clusters and not necessarily HPC/ HTC.

I would be interested to know or contribute to any work towards supporting
MPI on Mesos planned in near future.

Thanks and Regards,
Mangirish

CC: Airavata dev mailing list.

On Fri, Oct 14, 2016 at 12:21 PM, Joseph Wu  wrote:

> Other than test frameworks or frameworks Mesos considers part of its CLI,
> there shouldn't be any other Frameworks that are part of the Mesos
> codebase.  (Imagine shipping Spark or Marathon or a bunch of other
> humongous frameworks along with Mesos.)  Same thing goes for MPI, which may
> or may not even work anymore.  I don't know anyone that has run the MPI
> framework in the past several years.
>
> On Fri, Oct 14, 2016 at 8:51 AM, Mangirish Wagle  >
> wrote:
>
> > Thanks for the response.
> > May I know if there are any reasons for not continuing to develop and
> > support MPI framework? Are there any known issues with running MPI jobs
> on
> > Mesos?
> >
> > Best Regards,
> > Mangirish
> >
> > On Fri, Oct 14, 2016 at 2:20 AM, haosdent  wrote:
> >
> > > Refer to https://issues.apache.org/jira/browse/MESOS-6084, I think the
> > MPI
> > > framework would be deprecated.
> > >
> > > On Fri, Oct 14, 2016 at 1:57 PM, Mangirish Wagle <
> > vaglomangir...@gmail.com
> > > >
> > > wrote:
> > >
> > > > Hello Mesos Devs,
> > > >
> > > > I am contributing to Apache Airavata 
> and
> > > > currently working on extending the support for the science gateways
> to
> > > run
> > > > MPI jobs on cloud based Mesos clusters.
> > > >
> > > > I am looking at mpiexec-mesos
> > > >  and Mesos Hydra
> > > >  but I am also interested
> > in
> > > > knowing about any latest work that is being done in this area. In
> > > general,
> > > > I want to seek your advice and thoughts on what is the right tool
> that
> > I
> > > > should use, and the appropriate direction to proceed to achieve the
> > > > objective of running MPI jobs on Mesos.
> > > >
> > > > Thank you.
> > > >
> > > > Regards,
> > > > Mangirish Wagle
> > > > Graduate Student, Indiana University Bloomington.
> > > >
> > >
> > >
> > >
> > > --
> > > Best Regards,
> > > Haosdent Huang
> > >
> >
>

Re: Need inputs on running MPI jobs on Mesos

[Joseph Wu]

Other than test frameworks or frameworks Mesos considers part of its CLI,
there shouldn't be any other Frameworks that are part of the Mesos
codebase.  (Imagine shipping Spark or Marathon or a bunch of other
humongous frameworks along with Mesos.)  Same thing goes for MPI, which may
or may not even work anymore.  I don't know anyone that has run the MPI
framework in the past several years.

On Fri, Oct 14, 2016 at 8:51 AM, Mangirish Wagle 
wrote:

> Thanks for the response.
> May I know if there are any reasons for not continuing to develop and
> support MPI framework? Are there any known issues with running MPI jobs on
> Mesos?
>
> Best Regards,
> Mangirish
>
> On Fri, Oct 14, 2016 at 2:20 AM, haosdent  wrote:
>
> > Refer to https://issues.apache.org/jira/browse/MESOS-6084, I think the
> MPI
> > framework would be deprecated.
> >
> > On Fri, Oct 14, 2016 at 1:57 PM, Mangirish Wagle <
> vaglomangir...@gmail.com
> > >
> > wrote:
> >
> > > Hello Mesos Devs,
> > >
> > > I am contributing to Apache Airavata  and
> > > currently working on extending the support for the science gateways to
> > run
> > > MPI jobs on cloud based Mesos clusters.
> > >
> > > I am looking at mpiexec-mesos
> > >  and Mesos Hydra
> > >  but I am also interested
> in
> > > knowing about any latest work that is being done in this area. In
> > general,
> > > I want to seek your advice and thoughts on what is the right tool that
> I
> > > should use, and the appropriate direction to proceed to achieve the
> > > objective of running MPI jobs on Mesos.
> > >
> > > Thank you.
> > >
> > > Regards,
> > > Mangirish Wagle
> > > Graduate Student, Indiana University Bloomington.
> > >
> >
> >
> >
> > --
> > Best Regards,
> > Haosdent Huang
> >
>

Re: Need inputs on running MPI jobs on Mesos

[Mangirish Wagle]

Thanks for the response.
May I know if there are any reasons for not continuing to develop and
support MPI framework? Are there any known issues with running MPI jobs on
Mesos?

Best Regards,
Mangirish

On Fri, Oct 14, 2016 at 2:20 AM, haosdent  wrote:

> Refer to https://issues.apache.org/jira/browse/MESOS-6084, I think the MPI
> framework would be deprecated.
>
> On Fri, Oct 14, 2016 at 1:57 PM, Mangirish Wagle  >
> wrote:
>
> > Hello Mesos Devs,
> >
> > I am contributing to Apache Airavata  and
> > currently working on extending the support for the science gateways to
> run
> > MPI jobs on cloud based Mesos clusters.
> >
> > I am looking at mpiexec-mesos
> >  and Mesos Hydra
> >  but I am also interested in
> > knowing about any latest work that is being done in this area. In
> general,
> > I want to seek your advice and thoughts on what is the right tool that I
> > should use, and the appropriate direction to proceed to achieve the
> > objective of running MPI jobs on Mesos.
> >
> > Thank you.
> >
> > Regards,
> > Mangirish Wagle
> > Graduate Student, Indiana University Bloomington.
> >
>
>
>
> --
> Best Regards,
> Haosdent Huang
>

Re: Need inputs on running MPI jobs on Mesos

[haosdent]

Refer to https://issues.apache.org/jira/browse/MESOS-6084, I think the MPI
framework would be deprecated.

On Fri, Oct 14, 2016 at 1:57 PM, Mangirish Wagle 
wrote:

> Hello Mesos Devs,
>
> I am contributing to Apache Airavata  and
> currently working on extending the support for the science gateways to run
> MPI jobs on cloud based Mesos clusters.
>
> I am looking at mpiexec-mesos
>  and Mesos Hydra
>  but I am also interested in
> knowing about any latest work that is being done in this area. In general,
> I want to seek your advice and thoughts on what is the right tool that I
> should use, and the appropriate direction to proceed to achieve the
> objective of running MPI jobs on Mesos.
>
> Thank you.
>
> Regards,
> Mangirish Wagle
> Graduate Student, Indiana University Bloomington.
>



-- 
Best Regards,
Haosdent Huang

Need inputs on running MPI jobs on Mesos

[Mangirish Wagle]

Hello Mesos Devs,

I am contributing to Apache Airavata  and
currently working on extending the support for the science gateways to run
MPI jobs on cloud based Mesos clusters.

I am looking at mpiexec-mesos
 and Mesos Hydra
 but I am also interested in
knowing about any latest work that is being done in this area. In general,
I want to seek your advice and thoughts on what is the right tool that I
should use, and the appropriate direction to proceed to achieve the
objective of running MPI jobs on Mesos.

Thank you.

Regards,
Mangirish Wagle
Graduate Student, Indiana University Bloomington.