Hello Jens, 2017-01-25 13:03 GMT+01:00 Jens Timmerman <[email protected]>:
> Hello Gunnar, > > > On 24/01/2017 19:54, Gunnar Sauer wrote: > > Hello EasyBuild experts, > > > > > But which toolchain do I choose on the Xeon cluster, which provides > > all those optimized tools through already existing modules? Can I > > tweak the goolf toolchain to use the existing system modules? > Yes, you could create your own toolchain to use the already existing > modules, this is exactly how the Cray toolchain works, see > http://easybuild.readthedocs.io/en/latest/Using_external_modules.html > for more information on how to create your own toolchain from existing > compilers and libraries. > Ok, I'll try to understand the details how to set up a new toolchain and go this path. I have found the GCC-system, which seems to lead in the right direction. Would it be feasible to extend GCC-system to include OpenMPI-system and OpenBLAS-system in a similar fashion? And yes, these toolchains have infiniband support. > > So, it would be very nice to know what optimizations are being done at > your company that make the internal toolchain even better optimized, so > all EasyBuild > users could all benefit from this knowledge and potentially millions of > CPU hours could be saved. > I will see, whether they share the details with me, or if they even have the details. As I understood, the cluster has been set up and is maintained by an external company. When we discussed today using the foss stack, I only got very discouraging answers: infiniband couldn't be configured correctly using a generic MPI installation procedure, BLAS would be an order of magnitude slower unless you put in the correct parameters for the specific architecture, etc. Nevertheless, I am currently trying to set up the HPL benchmark, and I will compare the results with easybuild's foss toolchain and with the cluster's 'builtin' toolchain. I'm really serious here, if you can share this information, we would > love to hear it so we can incorporate, but I do understand that this > might be proprietary information. > > TL;DR: > If you can share your highly optimized toolchains with us we will be > pleased to support them in EasyBuild if they can help us getting faster > software runtimes! > > Also thanks for the other replies! I need to gain some more experience with EasyBuild before I can make use of all your suggestions. Gunnar
