Re: [OMPI devel] MTT Perl client

2018-09-14 Thread Jeff Squyres (jsquyres) via devel
On Sep 14, 2018, at 12:37 PM, Gilles Gouaillardet 
 wrote:
> 
> IIRC mtt-relay is not only a proxy (squid can do that too).

Probably true.  IIRC, I think mtt-relay was meant to be a 
dirt-stupid-but-focused-to-just-one-destination relay.

> mtt results can be manually copied from a cluster behind a firewall, and then 
> mtt-relay can “upload” these results to mtt.open-MPI.org

Yes, but then a human has to be involved, which kinda defeats at least one of 
the goals of MTT.  Using mtt-relay allowed MTT to still function in an 
automated fashion.

FWIW, it may not be necessary to convert mtt-relay to python (IIRC that it's 
protocol agnostic, but like I said: it's been quite a while since I've looked 
at that code).  It was pretty small and straightforward.  It could also just 
stay in mtt-legacy.

-- 
Jeff Squyres
jsquy...@cisco.com

___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] MTT Perl client

2018-09-14 Thread Gilles Gouaillardet
IIRC mtt-relay is not only a proxy (squid can do that too).
mtt results can be manually copied from a cluster behind a firewall, and
then mtt-relay can “upload” these results to mtt.open-MPI.org

My 0.02US$

Gilles

On Saturday, September 15, 2018, Jeff Squyres (jsquyres) via devel <
devel@lists.open-mpi.org> wrote:

> It's for environments where MTT is run where it can't reach the greater
> internet (or, at least, it can't POST to the greater internet).  You run
> the mtt-relay on a machine that is reachable by your machines running MTT,
> and it works as a relay to mtt.open-mpi.org so that you can submit your
> MTT results.
>
> It might actually be fairly protocol agnostic, IIRC (been a while since
> I've looked at that code).
>
>
>
> > On Sep 14, 2018, at 11:23 AM, Ralph H Castain  wrote:
> >
> > Afraid I’m not familiar with that script - what does it do?
> >
> >
> >> On Sep 14, 2018, at 7:46 AM, Christoph Niethammer 
> wrote:
> >>
> >> Works for the installation at HLRS.
> >>
> >> Short note/question: I am using the mtt-relay script. This is written
> in perl. Is there a python based replacement?
> >>
> >> Best
> >> Christoph Niethammer
> >>
> >> - Mensaje original -
> >> De: "Open MPI Developers" 
> >> Para: "Open MPI Developers" 
> >> CC: "Jeff Squyres" 
> >> Enviados: Martes, 11 de Septiembre 2018 20:37:40
> >> Asunto: Re: [OMPI devel] MTT Perl client
> >>
> >> Works for me.
> >>
> >>> On Sep 11, 2018, at 12:35 PM, Ralph H Castain 
> wrote:
> >>>
> >>> Hi folks
> >>>
> >>> Per today’s telecon, I have moved the Perl MTT client into its own
> repository: https://github.com/open-mpi/mtt-legacy. All the Python client
> code has been removed from that repo.
> >>>
> >>> The original MTT repo remains at https://github.com/open-mpi/mtt. I
> have a PR to remove all the Perl client code and associated libs/modules
> from that repo. We won’t commit it until people have had a chance to switch
> to the mtt-legacy repo and verify that things still work for them.
> >>>
> >>> Please let us know if mtt-legacy is okay or has a problem.
> >>>
> >>> Thanks
> >>> Ralph
> >>>
> >>> ___
> >>> devel mailing list
> >>> devel@lists.open-mpi.org
> >>> https://lists.open-mpi.org/mailman/listinfo/devel
> >>
> >>
> >> --
> >> Jeff Squyres
> >> jsquy...@cisco.com
> >>
> >> ___
> >> devel mailing list
> >> devel@lists.open-mpi.org
> >> https://lists.open-mpi.org/mailman/listinfo/devel
> >> ___
> >> devel mailing list
> >> devel@lists.open-mpi.org
> >> https://lists.open-mpi.org/mailman/listinfo/devel
> >
> > ___
> > devel mailing list
> > devel@lists.open-mpi.org
> > https://lists.open-mpi.org/mailman/listinfo/devel
>
>
> --
> Jeff Squyres
> jsquy...@cisco.com
>
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/devel
___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] MTT Perl client

2018-09-14 Thread Ralph H Castain
I very much doubt that there is a Python equivalent yet.

> On Sep 14, 2018, at 9:23 AM, Jeff Squyres (jsquyres) via devel 
>  wrote:
> 
> It's for environments where MTT is run where it can't reach the greater 
> internet (or, at least, it can't POST to the greater internet).  You run the 
> mtt-relay on a machine that is reachable by your machines running MTT, and it 
> works as a relay to mtt.open-mpi.org so that you can submit your MTT results.
> 
> It might actually be fairly protocol agnostic, IIRC (been a while since I've 
> looked at that code).
> 
> 
> 
>> On Sep 14, 2018, at 11:23 AM, Ralph H Castain  wrote:
>> 
>> Afraid I’m not familiar with that script - what does it do?
>> 
>> 
>>> On Sep 14, 2018, at 7:46 AM, Christoph Niethammer  
>>> wrote:
>>> 
>>> Works for the installation at HLRS.
>>> 
>>> Short note/question: I am using the mtt-relay script. This is written in 
>>> perl. Is there a python based replacement?
>>> 
>>> Best
>>> Christoph Niethammer
>>> 
>>> - Mensaje original -
>>> De: "Open MPI Developers" 
>>> Para: "Open MPI Developers" 
>>> CC: "Jeff Squyres" 
>>> Enviados: Martes, 11 de Septiembre 2018 20:37:40
>>> Asunto: Re: [OMPI devel] MTT Perl client
>>> 
>>> Works for me.
>>> 
 On Sep 11, 2018, at 12:35 PM, Ralph H Castain  wrote:
 
 Hi folks
 
 Per today’s telecon, I have moved the Perl MTT client into its own 
 repository: https://github.com/open-mpi/mtt-legacy. All the Python client 
 code has been removed from that repo.
 
 The original MTT repo remains at https://github.com/open-mpi/mtt. I have a 
 PR to remove all the Perl client code and associated libs/modules from 
 that repo. We won’t commit it until people have had a chance to switch to 
 the mtt-legacy repo and verify that things still work for them.
 
 Please let us know if mtt-legacy is okay or has a problem.
 
 Thanks
 Ralph
 
 ___
 devel mailing list
 devel@lists.open-mpi.org
 https://lists.open-mpi.org/mailman/listinfo/devel
>>> 
>>> 
>>> -- 
>>> Jeff Squyres
>>> jsquy...@cisco.com
>>> 
>>> ___
>>> devel mailing list
>>> devel@lists.open-mpi.org
>>> https://lists.open-mpi.org/mailman/listinfo/devel
>>> ___
>>> devel mailing list
>>> devel@lists.open-mpi.org
>>> https://lists.open-mpi.org/mailman/listinfo/devel
>> 
>> ___
>> devel mailing list
>> devel@lists.open-mpi.org
>> https://lists.open-mpi.org/mailman/listinfo/devel
> 
> 
> -- 
> Jeff Squyres
> jsquy...@cisco.com
> 
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/devel

___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] MTT Perl client

2018-09-14 Thread Jeff Squyres (jsquyres) via devel
It's for environments where MTT is run where it can't reach the greater 
internet (or, at least, it can't POST to the greater internet).  You run the 
mtt-relay on a machine that is reachable by your machines running MTT, and it 
works as a relay to mtt.open-mpi.org so that you can submit your MTT results.

It might actually be fairly protocol agnostic, IIRC (been a while since I've 
looked at that code).



> On Sep 14, 2018, at 11:23 AM, Ralph H Castain  wrote:
> 
> Afraid I’m not familiar with that script - what does it do?
> 
> 
>> On Sep 14, 2018, at 7:46 AM, Christoph Niethammer  wrote:
>> 
>> Works for the installation at HLRS.
>> 
>> Short note/question: I am using the mtt-relay script. This is written in 
>> perl. Is there a python based replacement?
>> 
>> Best
>> Christoph Niethammer
>> 
>> - Mensaje original -
>> De: "Open MPI Developers" 
>> Para: "Open MPI Developers" 
>> CC: "Jeff Squyres" 
>> Enviados: Martes, 11 de Septiembre 2018 20:37:40
>> Asunto: Re: [OMPI devel] MTT Perl client
>> 
>> Works for me.
>> 
>>> On Sep 11, 2018, at 12:35 PM, Ralph H Castain  wrote:
>>> 
>>> Hi folks
>>> 
>>> Per today’s telecon, I have moved the Perl MTT client into its own 
>>> repository: https://github.com/open-mpi/mtt-legacy. All the Python client 
>>> code has been removed from that repo.
>>> 
>>> The original MTT repo remains at https://github.com/open-mpi/mtt. I have a 
>>> PR to remove all the Perl client code and associated libs/modules from that 
>>> repo. We won’t commit it until people have had a chance to switch to the 
>>> mtt-legacy repo and verify that things still work for them.
>>> 
>>> Please let us know if mtt-legacy is okay or has a problem.
>>> 
>>> Thanks
>>> Ralph
>>> 
>>> ___
>>> devel mailing list
>>> devel@lists.open-mpi.org
>>> https://lists.open-mpi.org/mailman/listinfo/devel
>> 
>> 
>> -- 
>> Jeff Squyres
>> jsquy...@cisco.com
>> 
>> ___
>> devel mailing list
>> devel@lists.open-mpi.org
>> https://lists.open-mpi.org/mailman/listinfo/devel
>> ___
>> devel mailing list
>> devel@lists.open-mpi.org
>> https://lists.open-mpi.org/mailman/listinfo/devel
> 
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/devel


-- 
Jeff Squyres
jsquy...@cisco.com

___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] Cannot find libverbs when without-verbs is used

2018-09-14 Thread Mijakovic, Robert
I'm afraid that I don't know the answer to this question. I need to check with 
the guy that installed fabrics on the machine.

I can tell you only that it missed devel package of libibverbs. Once it was 
installed the error was gone.

On 11.09.18, 16:53, "devel on behalf of Jeff Squyres (jsquyres) via devel" 
 wrote:

I notice from your configure log that you're building Mellanox MXM support.

Does that pull in libibverbs as a dependent library?


> On Sep 11, 2018, at 7:23 AM, Mijakovic, Robert  
wrote:
> 
> Hi guys,
> 
> I have configured OpenMPI to build without-verbs but the build fails with 
an error saying that ld cannot find libverbs.
> 
> Configure:
> ==> 
'/home/hpc/pr28fa/di52sut/spack_lrz/spack/var/spack/stage/openmpi-3.1.2-jg4gwt4cjfgu66vyq5pox7yavfwzri3m/openmpi-3.1.2/configure'
 
'--prefix=/home/hpc/pr28fa/di52sut/spack_lrz/spack/opt/x86_avx2/linux-sles12-x86_64/gcc-7.3.0/openmpi-3.1.2-jg4gwt4cjfgu66vyq5pox7yavfwzri3m'
 '--enable-shared' 
'--with-wrapper-ldflags=-Wl,-rpath,/lrz/sys/compilers/gcc/7.3.0/lib64' 
'--enable-static' '--without-pmi' '--enable-mpi-cxx' 
'--with-zlib=/home/hpc/pr28fa/di52sut/spack_lrz/spack/opt/x86_avx2/linux-sles12-x86_64/gcc-7.3.0/zlib-1.2.11-ajxhsmrlv2kvicpk3gdckgrroxr45mdl'
 '--without-psm' '--without-psm2' '--without-verbs' 
'--with-mxm=/opt/mellanox/mxm' '--without-ucx' '--without-libfabric' 
'--without-alps' '--without-lsf' '--without-tm' '--without-slurm' 
'--without-sge' '--without-loadleveler' '--disable-memchecker' 
'--with-hwloc=/home/hpc/pr28fa/di52sut/spack_lrz/spack/opt/x86_avx2/linux-sles12-x86_64/gcc-7.3.0/hwloc-1.11.9-c4ktzih4jwg673rwwzgy4zvofd75tgvo'
 '--disable-java' '--disable-mpi-java' '--without-cuda' 
'--enable-cxx-exceptions’
> 
> Build:
>   CCLD libmpi.la
> 
/home/hpc/pr28fa/di52sut/spack_lrz/spack/opt/x86_avx2/linux-sles12-x86_64/gcc-7.3.0/binutils-2.31.1-ntosmj7bfrraftmq4jbvwbu6xnt3kbrz/bin/ld:
 cannot find -libverbs
> 
> Attach please find the complete log.
> 
> 
> Thank you for your time.
> 
> Best regards,
> Robert
> --
> Dr. Robert Mijaković
> 
> Leibniz Supercomputing Centre
> HPC Systems and Services
> Boltzmannstr. 1
> D-85748 Garching
> Room I.2.034
> Phone:  +49 89 35831 8734
> Fax: +49 89 35831 9700
> Mobile:+49 (157) 786 605 00
> mailto:robert.mijako...@lrz.de
> 
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/devel


-- 
Jeff Squyres
jsquy...@cisco.com

___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] MTT Perl client

2018-09-14 Thread Ralph H Castain
Afraid I’m not familiar with that script - what does it do?


> On Sep 14, 2018, at 7:46 AM, Christoph Niethammer  wrote:
> 
> Works for the installation at HLRS.
> 
> Short note/question: I am using the mtt-relay script. This is written in 
> perl. Is there a python based replacement?
> 
> Best
> Christoph Niethammer
> 
> - Mensaje original -
> De: "Open MPI Developers" 
> Para: "Open MPI Developers" 
> CC: "Jeff Squyres" 
> Enviados: Martes, 11 de Septiembre 2018 20:37:40
> Asunto: Re: [OMPI devel] MTT Perl client
> 
> Works for me.
> 
>> On Sep 11, 2018, at 12:35 PM, Ralph H Castain  wrote:
>> 
>> Hi folks
>> 
>> Per today’s telecon, I have moved the Perl MTT client into its own 
>> repository: https://github.com/open-mpi/mtt-legacy. All the Python client 
>> code has been removed from that repo.
>> 
>> The original MTT repo remains at https://github.com/open-mpi/mtt. I have a 
>> PR to remove all the Perl client code and associated libs/modules from that 
>> repo. We won’t commit it until people have had a chance to switch to the 
>> mtt-legacy repo and verify that things still work for them.
>> 
>> Please let us know if mtt-legacy is okay or has a problem.
>> 
>> Thanks
>> Ralph
>> 
>> ___
>> devel mailing list
>> devel@lists.open-mpi.org
>> https://lists.open-mpi.org/mailman/listinfo/devel
> 
> 
> -- 
> Jeff Squyres
> jsquy...@cisco.com
> 
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/devel
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/devel

___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] MTT Perl client

2018-09-14 Thread Christoph Niethammer
Works for the installation at HLRS.

Short note/question: I am using the mtt-relay script. This is written in perl. 
Is there a python based replacement?

Best
Christoph Niethammer

- Mensaje original -
De: "Open MPI Developers" 
Para: "Open MPI Developers" 
CC: "Jeff Squyres" 
Enviados: Martes, 11 de Septiembre 2018 20:37:40
Asunto: Re: [OMPI devel] MTT Perl client

Works for me.

> On Sep 11, 2018, at 12:35 PM, Ralph H Castain  wrote:
> 
> Hi folks
> 
> Per today’s telecon, I have moved the Perl MTT client into its own 
> repository: https://github.com/open-mpi/mtt-legacy. All the Python client 
> code has been removed from that repo.
> 
> The original MTT repo remains at https://github.com/open-mpi/mtt. I have a PR 
> to remove all the Perl client code and associated libs/modules from that 
> repo. We won’t commit it until people have had a chance to switch to the 
> mtt-legacy repo and verify that things still work for them.
> 
> Please let us know if mtt-legacy is okay or has a problem.
> 
> Thanks
> Ralph
> 
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://lists.open-mpi.org/mailman/listinfo/devel


-- 
Jeff Squyres
jsquy...@cisco.com

___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel
___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel