Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?

2023-03-14 Thread Kenneth Hoste




On 14/03/2023 11:04, Ole Holm Nielsen wrote:

On 2/15/23 15:30, Jure Pečar wrote:

On Wed, 15 Feb 2023 15:26:26 +0100
Ole Holm Nielsen  wrote:


Is "foss" also the preferred toolchain on AMD Rome and Genoa?


For now, yes.

There's some work going on to create a toolchain around amd compilers but
it's questionable how much you gain as all features these compilers and
libs bring eventually end up in upstream llvm and gcc.

So for Genoa look for upcoming foss toolchain built around gcc 13. For
Rome and Milan existing ones with gcc 11 and 12 are already working fine.


Sorry for my late reply.  The latest GCC in EasyBuild is 12.2.0.  Is 
there any way to build GCC 13 with EasyBuild so that we can test AMD Genoa?


There is no official release yet of GCC 13.x, but you could take the 
easyconfig file for the latest GCC(core), and use a release candidate 
for GCC 13.x if you want to start experimenting with it.


Usually when there's a new GCC release, we have an easyconfig PR for 
that version available soon after.



Obviously, a lot of other modules are needed as well, so when can a foss 
toolchain with GCC 13 be hoped for?


We're always a bit reluctant to pick up the first dot release of a new 
major compiler version (like 13.1) since we've learned the hard way that 
quite a bit get fixed in the first bugfix release (13.2 for example).


So for foss/2023a, we'll likely go with GCC 12.3 rather than 13.1, 
unless there are good (technical) reasons not to.


CUDA compatibility is a minor factor as well: initially foss/2023a could 
be CPU-only, until a CUDA release that is compatible with whatever GCC 
version is used in that foss version is available.
This is part of the reason for moving away from fosscuda towards 
foss+CUDA in recent foss versions.



regards,

Kenneth



Thanks,
Ole





AW: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?

2023-03-14 Thread Dr. Stefan Harfst
Dear Ole,

we are currently facing the same issue, I guess we will start installing 
software in April. At the moment we have not made a decision about the 
toolchains, but we probably start with which ever version of the foss-toolchain 
is available by then. In principle, you could use a site-specific definition of 
the foss-toolchain and replace the GCC-version, but that might lead to 
complications later on. One of these complications could be the combination of 
foss and CUDA, because the recent CUDA 12.1 only support GCC up to version 12.2.

Best wishes
Stefan

--
Scientific Computing

Carl von Ossietzky University Oldenburg
School of Mathematics and Natural Sciences
26111 Oldenburg, Germany

Office: W03 1-139
Phone: +49-441-798 3147
E-Mail: stefan.har...@uni-oldenburg.de
www: http://www.uni-oldenburg.de/fk5/wr

-Ursprüngliche Nachricht-
Von: easybuild-requ...@lists.ugent.be  Im 
Auftrag von Ole Holm Nielsen
Gesendet: Dienstag, 14. März 2023 11:05
An: easybuild@lists.ugent.be
Betreff: Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?

ACHTUNG! Diese E-Mail kommt von Extern! WARNING! This email originated 
off-campus.

On 2/15/23 15:30, Jure Pečar wrote:
> On Wed, 15 Feb 2023 15:26:26 +0100
> Ole Holm Nielsen  wrote:
>
>> Is "foss" also the preferred toolchain on AMD Rome and Genoa?
>
> For now, yes.
>
> There's some work going on to create a toolchain around amd compilers 
> but it's questionable how much you gain as all features these 
> compilers and libs bring eventually end up in upstream llvm and gcc.
>
> So for Genoa look for upcoming foss toolchain built around gcc 13. For 
> Rome and Milan existing ones with gcc 11 and 12 are already working fine.

Sorry for my late reply.  The latest GCC in EasyBuild is 12.2.0.  Is there any 
way to build GCC 13 with EasyBuild so that we can test AMD Genoa?

Obviously, a lot of other modules are needed as well, so when can a foss 
toolchain with GCC 13 be hoped for?

Thanks,
Ole

--
Ole Holm Nielsen
PhD, Senior HPC Officer
Department of Physics, Technical University of Denmark


smime.p7s
Description: S/MIME cryptographic signature


Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?

2023-03-14 Thread Ole Holm Nielsen

On 2/15/23 15:30, Jure Pečar wrote:

On Wed, 15 Feb 2023 15:26:26 +0100
Ole Holm Nielsen  wrote:


Is "foss" also the preferred toolchain on AMD Rome and Genoa?


For now, yes.

There's some work going on to create a toolchain around amd compilers but
it's questionable how much you gain as all features these compilers and
libs bring eventually end up in upstream llvm and gcc.

So for Genoa look for upcoming foss toolchain built around gcc 13. For
Rome and Milan existing ones with gcc 11 and 12 are already working fine.


Sorry for my late reply.  The latest GCC in EasyBuild is 12.2.0.  Is there 
any way to build GCC 13 with EasyBuild so that we can test AMD Genoa?


Obviously, a lot of other modules are needed as well, so when can a foss 
toolchain with GCC 13 be hoped for?


Thanks,
Ole

--
Ole Holm Nielsen
PhD, Senior HPC Officer
Department of Physics, Technical University of Denmark


Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?

2023-02-15 Thread Jure Pečar
On Wed, 15 Feb 2023 15:26:26 +0100
Ole Holm Nielsen  wrote:

> Is "foss" also the preferred toolchain on AMD Rome and Genoa?

For now, yes.

There's some work going on to create a toolchain around amd compilers but
it's questionable how much you gain as all features these compilers and
libs bring eventually end up in upstream llvm and gcc.

So for Genoa look for upcoming foss toolchain built around gcc 13. For
Rome and Milan existing ones with gcc 11 and 12 are already working fine.


-- 

  Jurij Pečar
  HPC Engineer, IT Operations, IT Services
  EMBL Heidelberg, Meyerhofstraße 1, 69117, Heidelberg, Germany
  Room 13-401


[easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?

2023-02-15 Thread Ole Holm Nielsen
In an upcoming procurement we plan to use a GPAW EasyBuild module for 
benchmarking.  On 4th Gen Intel Xeon Scalable processors we should 
presumably specify a recent "intel" toolchain because of support for the 
latest instructions.


Question: Which toolchain to use on AMD EPYC 9004 "Genoa"?

There are a number of sites out there with AMD clusters, and I wonder 
which optimal and reliable toolchains people use with AMD Rome and Genoa?


We have often used the "foss" toolchain on Intel Xeon because it provides 
OpenMPI, OpenBLAS, ScaLAPACK, and FFTW modules for the GPAW code.  Is 
"foss" also the preferred toolchain on AMD Rome and Genoa?


Looking at the long toolchain list in 
https://docs.easybuild.io/version-specific/toolchains/ I'm not much wiser 
:-(  None of these toolchains seems to use the AMD AOCC compiler, and I 
wonder why?


Thanks for sharing any advice and experiences!

Best regards,
Ole

--
Ole Holm Nielsen
PhD, Senior HPC Officer
Department of Physics, Technical University of Denmark