Dear Inge,
(I've added the EasyBuild mailing list back in CC)
On 05/04/2019 11:46, Inge Gutheil wrote:
Hi Kenneth,
there is another problem with the new elpa.py easyblock.
After adding
if 'avx512bw' in avail_cpu_features:
avail_cpu_features.append('avx512')
it works for the standard installations, but it fails for the GPU version.
The problem seems to be in the
if with_mpi:
mpi_configopt = '--with-mpi=yes'
linalgopt = 'LIBS="$LIBSCALAPACK"'
else:
mpi_configopt = '--with-mpi=no'
linalgopt = 'LIBS="$LIBLAPACK"'
This leads to
== 2019-04-04 13:04:04,326 run.py:192 INFO running cmd: make -j 48
LIBS="$LIBLAPACK" V=1
during the make phase of ELPA and not
== 2019-03-15 15:01:18,397 run.py:192 INFO running cmd: make -j 48 V=1
without any libs. By that 'LIBS=' the LIBS that was found during
configure which added -lcudart -lcublas is overwritten and thus all the
cuda and cublas routines are no longer found.
If I modify as damian told me to
preconfigopts = 'export LIBS="-lcudart -lcublas" && '
it works for most link steps, but in some of the steps the -lcudart
-lcublas is still missing. So it seems to always be a problem to
overwrite LIBS during make even though it now is
== 2019-04-05 10:13:14,743 run.py:192 INFO running cmd: make -j 48
LIBS="$LIBLAPACK $LIBS" V=1
and thus should take the $LIBS
It does so vor a long while and suddenly omits the -lcudart -lcublas
again, I don't know how that comes.
Do you have any idea?
I don't know from the top of my head, I would have to try this myself
and deep dive into the log file...
Do you have a (debug) log file you can share with us that exhibits this
problem?
Maybe also include the modified elpa.py easyblock and the easyconfig
file (*.eb) you are using, so we can try and reproduce the problem.
regards,
Kenneth
Regards
Inge
