Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?
On 14/03/2023 11:04, Ole Holm Nielsen wrote: On 2/15/23 15:30, Jure Pečar wrote: On Wed, 15 Feb 2023 15:26:26 +0100 Ole Holm Nielsen wrote: Is "foss" also the preferred toolchain on AMD Rome and Genoa? For now, yes. There's some work going on to create a toolchain around amd compilers but it's questionable how much you gain as all features these compilers and libs bring eventually end up in upstream llvm and gcc. So for Genoa look for upcoming foss toolchain built around gcc 13. For Rome and Milan existing ones with gcc 11 and 12 are already working fine. Sorry for my late reply. The latest GCC in EasyBuild is 12.2.0. Is there any way to build GCC 13 with EasyBuild so that we can test AMD Genoa? There is no official release yet of GCC 13.x, but you could take the easyconfig file for the latest GCC(core), and use a release candidate for GCC 13.x if you want to start experimenting with it. Usually when there's a new GCC release, we have an easyconfig PR for that version available soon after. Obviously, a lot of other modules are needed as well, so when can a foss toolchain with GCC 13 be hoped for? We're always a bit reluctant to pick up the first dot release of a new major compiler version (like 13.1) since we've learned the hard way that quite a bit get fixed in the first bugfix release (13.2 for example). So for foss/2023a, we'll likely go with GCC 12.3 rather than 13.1, unless there are good (technical) reasons not to. CUDA compatibility is a minor factor as well: initially foss/2023a could be CPU-only, until a CUDA release that is compatible with whatever GCC version is used in that foss version is available. This is part of the reason for moving away from fosscuda towards foss+CUDA in recent foss versions. regards, Kenneth Thanks, Ole
AW: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?
Dear Ole, we are currently facing the same issue, I guess we will start installing software in April. At the moment we have not made a decision about the toolchains, but we probably start with which ever version of the foss-toolchain is available by then. In principle, you could use a site-specific definition of the foss-toolchain and replace the GCC-version, but that might lead to complications later on. One of these complications could be the combination of foss and CUDA, because the recent CUDA 12.1 only support GCC up to version 12.2. Best wishes Stefan -- Scientific Computing Carl von Ossietzky University Oldenburg School of Mathematics and Natural Sciences 26111 Oldenburg, Germany Office: W03 1-139 Phone: +49-441-798 3147 E-Mail: stefan.har...@uni-oldenburg.de www: http://www.uni-oldenburg.de/fk5/wr -Ursprüngliche Nachricht- Von: easybuild-requ...@lists.ugent.be Im Auftrag von Ole Holm Nielsen Gesendet: Dienstag, 14. März 2023 11:05 An: easybuild@lists.ugent.be Betreff: Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"? ACHTUNG! Diese E-Mail kommt von Extern! WARNING! This email originated off-campus. On 2/15/23 15:30, Jure Pečar wrote: > On Wed, 15 Feb 2023 15:26:26 +0100 > Ole Holm Nielsen wrote: > >> Is "foss" also the preferred toolchain on AMD Rome and Genoa? > > For now, yes. > > There's some work going on to create a toolchain around amd compilers > but it's questionable how much you gain as all features these > compilers and libs bring eventually end up in upstream llvm and gcc. > > So for Genoa look for upcoming foss toolchain built around gcc 13. For > Rome and Milan existing ones with gcc 11 and 12 are already working fine. Sorry for my late reply. The latest GCC in EasyBuild is 12.2.0. Is there any way to build GCC 13 with EasyBuild so that we can test AMD Genoa? Obviously, a lot of other modules are needed as well, so when can a foss toolchain with GCC 13 be hoped for? Thanks, Ole -- Ole Holm Nielsen PhD, Senior HPC Officer Department of Physics, Technical University of Denmark smime.p7s Description: S/MIME cryptographic signature
Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?
On 2/15/23 15:30, Jure Pečar wrote: On Wed, 15 Feb 2023 15:26:26 +0100 Ole Holm Nielsen wrote: Is "foss" also the preferred toolchain on AMD Rome and Genoa? For now, yes. There's some work going on to create a toolchain around amd compilers but it's questionable how much you gain as all features these compilers and libs bring eventually end up in upstream llvm and gcc. So for Genoa look for upcoming foss toolchain built around gcc 13. For Rome and Milan existing ones with gcc 11 and 12 are already working fine. Sorry for my late reply. The latest GCC in EasyBuild is 12.2.0. Is there any way to build GCC 13 with EasyBuild so that we can test AMD Genoa? Obviously, a lot of other modules are needed as well, so when can a foss toolchain with GCC 13 be hoped for? Thanks, Ole -- Ole Holm Nielsen PhD, Senior HPC Officer Department of Physics, Technical University of Denmark
Re: [easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?
On Wed, 15 Feb 2023 15:26:26 +0100 Ole Holm Nielsen wrote: > Is "foss" also the preferred toolchain on AMD Rome and Genoa? For now, yes. There's some work going on to create a toolchain around amd compilers but it's questionable how much you gain as all features these compilers and libs bring eventually end up in upstream llvm and gcc. So for Genoa look for upcoming foss toolchain built around gcc 13. For Rome and Milan existing ones with gcc 11 and 12 are already working fine. -- Jurij Pečar HPC Engineer, IT Operations, IT Services EMBL Heidelberg, Meyerhofstraße 1, 69117, Heidelberg, Germany Room 13-401
[easybuild] Which toolchain to use on AMD EPYC 9004 "Genoa"?
In an upcoming procurement we plan to use a GPAW EasyBuild module for benchmarking. On 4th Gen Intel Xeon Scalable processors we should presumably specify a recent "intel" toolchain because of support for the latest instructions. Question: Which toolchain to use on AMD EPYC 9004 "Genoa"? There are a number of sites out there with AMD clusters, and I wonder which optimal and reliable toolchains people use with AMD Rome and Genoa? We have often used the "foss" toolchain on Intel Xeon because it provides OpenMPI, OpenBLAS, ScaLAPACK, and FFTW modules for the GPAW code. Is "foss" also the preferred toolchain on AMD Rome and Genoa? Looking at the long toolchain list in https://docs.easybuild.io/version-specific/toolchains/ I'm not much wiser :-( None of these toolchains seems to use the AMD AOCC compiler, and I wonder why? Thanks for sharing any advice and experiences! Best regards, Ole -- Ole Holm Nielsen PhD, Senior HPC Officer Department of Physics, Technical University of Denmark