Re: [OMPI devel] Script-based wrapper compilers
Thanks for the note. I originally wrote the script wrapper compilers to make
it easy to build the wrappers in a cross-compile environment. With OMPI 5.0,
mpicc shouldn't even have a dependency on libopen-pal.so, so we've gotten to
the point where the right answer is to do what Fujitsu does. But I ended up
fixing the script wrapper compilers anyway, so they'll live on at least through
the 5.0 series.
Brian
On 4/4/22, 9:29 PM, "devel on behalf of t-kawashima--- via devel"
wrote:
CAUTION: This email originated from outside of the organization. Do not
click links or open attachments unless you can confirm the sender and know the
content is safe.
Jeff, Gilles,
I missed this mail thread.
As Gilles said, Fujitsu MPI provides both native- and cross-compiler for
Fujitsu AArch64 machines (including Fugaku). However, we don't use the
script-based wrapper compilers.
We prepare AArch64 binaries and x86_64 opal_wrapper command. Putting
AArch64 libraries and x86_64 opal_wrapper and writing wrapper-data.txt allows
cross compiling AArch64 MPI programs on x86_64.
Thanks,
Takahiro Kawashima,
Fujitsu
> Jeff,
>
> Cross compilation is the recommended way on Fugaku.
> In all fairness, even if Fujitsu MPI is based on Open MPI, they built the
> MPI wrappers (that invoke the cross compilers) on top of opal (read not
the
> scripts).
>
> Cheers,
>
> Gilles
>
> On Fri, Mar 25, 2022 at 1:06 AM Jeff Squyres (jsquyres)
> wrote:
>
> > Gilles --
> >
> > Do you know if anyone is actually cross compiling? I agree that this is
> > in the "nice to have" category, but it is costing Brian time -- if no
one
> > is using this functionality, it's not worth the time. If people are
using
> > this functionality, then it's potentially worth the time.
> >
> > --
> > Jeff Squyres
> > jsquy...@cisco.com
> >
> >
> > From: devel on behalf of Gilles
> > Gouaillardet via devel
> > Sent: Wednesday, March 23, 2022 10:28 PM
> > To: Open MPI Developers
> > Cc: Gilles Gouaillardet
> > Subject: Re: [OMPI devel] Script-based wrapper compilers
> >
> > Brian,
> >
> > My 0.02 US$
> >
> > Script based wrapper compilers are very useful when cross compiling,
> > so ideally, they should be maintained.
> >
> > Cheers,
> >
> > Gilles
> >
> > On Thu, Mar 24, 2022 at 11:18 AM Barrett, Brian via devel <
> > devel@lists.open-mpi.org<mailto:devel@lists.open-mpi.org>> wrote:
> > Does anyone still use the script based wrapper compilers? I have been
> > working on fixing a number of static library compile issues caused by us
> > historically not having been great about tracking library dependencies
and
> > the OMPI/PMIx/PRRTE split. Part of this is some fairly significant
> > modifications to the wrapper compilers (here's the PMIx version:
> >
https://github.com/openpmix/openpmix/commit/e15de4b52f2d331297bbca31beb54b5a377557bc).
> > It would be easiest to just remove the script based wrapper compilers,
but
> > I'll update them if someone uses them.
> >
> > Thanks,
> >
> > Brian
Re: [OMPI devel] Script-based wrapper compilers
Jeff, Gilles, I missed this mail thread. As Gilles said, Fujitsu MPI provides both native- and cross-compiler for Fujitsu AArch64 machines (including Fugaku). However, we don't use the script-based wrapper compilers. We prepare AArch64 binaries and x86_64 opal_wrapper command. Putting AArch64 libraries and x86_64 opal_wrapper and writing wrapper-data.txt allows cross compiling AArch64 MPI programs on x86_64. Thanks, Takahiro Kawashima, Fujitsu > Jeff, > > Cross compilation is the recommended way on Fugaku. > In all fairness, even if Fujitsu MPI is based on Open MPI, they built the > MPI wrappers (that invoke the cross compilers) on top of opal (read not the > scripts). > > Cheers, > > Gilles > > On Fri, Mar 25, 2022 at 1:06 AM Jeff Squyres (jsquyres) > wrote: > > > Gilles -- > > > > Do you know if anyone is actually cross compiling? I agree that this is > > in the "nice to have" category, but it is costing Brian time -- if no one > > is using this functionality, it's not worth the time. If people are using > > this functionality, then it's potentially worth the time. > > > > -- > > Jeff Squyres > > jsquy...@cisco.com > > > > > > From: devel on behalf of Gilles > > Gouaillardet via devel > > Sent: Wednesday, March 23, 2022 10:28 PM > > To: Open MPI Developers > > Cc: Gilles Gouaillardet > > Subject: Re: [OMPI devel] Script-based wrapper compilers > > > > Brian, > > > > My 0.02 US$ > > > > Script based wrapper compilers are very useful when cross compiling, > > so ideally, they should be maintained. > > > > Cheers, > > > > Gilles > > > > On Thu, Mar 24, 2022 at 11:18 AM Barrett, Brian via devel < > > devel@lists.open-mpi.org<mailto:devel@lists.open-mpi.org>> wrote: > > Does anyone still use the script based wrapper compilers? I have been > > working on fixing a number of static library compile issues caused by us > > historically not having been great about tracking library dependencies and > > the OMPI/PMIx/PRRTE split. Part of this is some fairly significant > > modifications to the wrapper compilers (here's the PMIx version: > > https://github.com/openpmix/openpmix/commit/e15de4b52f2d331297bbca31beb54b5a377557bc). > > It would be easiest to just remove the script based wrapper compilers, but > > I'll update them if someone uses them. > > > > Thanks, > > > > Brian
Re: [OMPI devel] Script-based wrapper compilers
Jeff, Cross compilation is the recommended way on Fugaku. In all fairness, even if Fujitsu MPI is based on Open MPI, they built the MPI wrappers (that invoke the cross compilers) on top of opal (read not the scripts). Cheers, Gilles On Fri, Mar 25, 2022 at 1:06 AM Jeff Squyres (jsquyres) wrote: > Gilles -- > > Do you know if anyone is actually cross compiling? I agree that this is > in the "nice to have" category, but it is costing Brian time -- if no one > is using this functionality, it's not worth the time. If people are using > this functionality, then it's potentially worth the time. > > -- > Jeff Squyres > jsquy...@cisco.com > > > From: devel on behalf of Gilles > Gouaillardet via devel > Sent: Wednesday, March 23, 2022 10:28 PM > To: Open MPI Developers > Cc: Gilles Gouaillardet > Subject: Re: [OMPI devel] Script-based wrapper compilers > > Brian, > > My 0.02 US$ > > Script based wrapper compilers are very useful when cross compiling, > so ideally, they should be maintained. > > Cheers, > > Gilles > > On Thu, Mar 24, 2022 at 11:18 AM Barrett, Brian via devel < > devel@lists.open-mpi.org<mailto:devel@lists.open-mpi.org>> wrote: > Does anyone still use the script based wrapper compilers? I have been > working on fixing a number of static library compile issues caused by us > historically not having been great about tracking library dependencies and > the OMPI/PMIx/PRRTE split. Part of this is some fairly significant > modifications to the wrapper compilers (here's the PMIx version: > https://github.com/openpmix/openpmix/commit/e15de4b52f2d331297bbca31beb54b5a377557bc). > It would be easiest to just remove the script based wrapper compilers, but > I'll update them if someone uses them. > > Thanks, > > Brian > >
Re: [OMPI devel] Script-based wrapper compilers
Dear all, instead of maintaining these scripts, maybe it is possible to have some build-mode of Open MPI which only builds these tools? AFAIR, all information for the opal-wrapper are in these .txt files. I.e., nothing inside the binary. So one could build Open MPI twice. First with the cross-compiler and install it. Then a second time building only the opal-wrapper and such binaries with the host compiler and install it over the previous installation, which replaces only the binaries, not the .txt files. Maybe this is even possible today, excluding the convenient second "installation" step? Best, Bert On 24.03.22 17:04, Jeff Squyres (jsquyres) via devel wrote: Gilles -- Do you know if anyone is actually cross compiling? I agree that this is in the "nice to have" category, but it is costing Brian time -- if no one is using this functionality, it's not worth the time. If people are using this functionality, then it's potentially worth the time. -- Jeff Squyres jsquy...@cisco.com From: devel on behalf of Gilles Gouaillardet via devel Sent: Wednesday, March 23, 2022 10:28 PM To: Open MPI Developers Cc: Gilles Gouaillardet Subject: Re: [OMPI devel] Script-based wrapper compilers Brian, My 0.02 US$ Script based wrapper compilers are very useful when cross compiling, so ideally, they should be maintained. Cheers, Gilles On Thu, Mar 24, 2022 at 11:18 AM Barrett, Brian via devel mailto:devel@lists.open-mpi.org>> wrote: Does anyone still use the script based wrapper compilers? I have been working on fixing a number of static library compile issues caused by us historically not having been great about tracking library dependencies and the OMPI/PMIx/PRRTE split. Part of this is some fairly significant modifications to the wrapper compilers (here's the PMIx version: https://github.com/openpmix/openpmix/commit/e15de4b52f2d331297bbca31beb54b5a377557bc). It would be easiest to just remove the script based wrapper compilers, but I'll update them if someone uses them. Thanks, Brian -- Dipl.-Inf. Bert Wesarg wiss. Mitarbeiter Technische Universität Dresden Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH) 01062 Dresden 📞 +49 (351) 463-42451 📠 +49 (351) 463-37773 📧 bert.wes...@tu-dresden.de 🏳️🌈 he/him/his smime.p7s Description: S/MIME Cryptographic Signature
Re: [OMPI devel] Script-based wrapper compilers
Gilles -- Do you know if anyone is actually cross compiling? I agree that this is in the "nice to have" category, but it is costing Brian time -- if no one is using this functionality, it's not worth the time. If people are using this functionality, then it's potentially worth the time. -- Jeff Squyres jsquy...@cisco.com From: devel on behalf of Gilles Gouaillardet via devel Sent: Wednesday, March 23, 2022 10:28 PM To: Open MPI Developers Cc: Gilles Gouaillardet Subject: Re: [OMPI devel] Script-based wrapper compilers Brian, My 0.02 US$ Script based wrapper compilers are very useful when cross compiling, so ideally, they should be maintained. Cheers, Gilles On Thu, Mar 24, 2022 at 11:18 AM Barrett, Brian via devel mailto:devel@lists.open-mpi.org>> wrote: Does anyone still use the script based wrapper compilers? I have been working on fixing a number of static library compile issues caused by us historically not having been great about tracking library dependencies and the OMPI/PMIx/PRRTE split. Part of this is some fairly significant modifications to the wrapper compilers (here's the PMIx version: https://github.com/openpmix/openpmix/commit/e15de4b52f2d331297bbca31beb54b5a377557bc). It would be easiest to just remove the script based wrapper compilers, but I'll update them if someone uses them. Thanks, Brian
Re: [OMPI devel] Script-based wrapper compilers
Brian, My 0.02 US$ Script based wrapper compilers are very useful when cross compiling, so ideally, they should be maintained. Cheers, Gilles On Thu, Mar 24, 2022 at 11:18 AM Barrett, Brian via devel < devel@lists.open-mpi.org> wrote: > Does anyone still use the script based wrapper compilers? I have been > working on fixing a number of static library compile issues caused by us > historically not having been great about tracking library dependencies and > the OMPI/PMIx/PRRTE split. Part of this is some fairly significant > modifications to the wrapper compilers (here's the PMIx version: > https://github.com/openpmix/openpmix/commit/e15de4b52f2d331297bbca31beb54b5a377557bc). > It would be easiest to just remove the script based wrapper compilers, but > I'll update them if someone uses them. > > Thanks, > > Brian > >
