This is exactly what the EASYBUILD_SUBDIR_USER_MODULES setting does but for
it to take effect you would have to have the env var set to, for example,
".local/EasyBuild/modules", and *you must rebuild all modules in the system
tree that extend the path, i.e.all the compiler and MPI modules *(but you
only need to rebuild the modules, not reinstall the packages)
On 13 October 2017 at 17:07, Maxime Boissonneault <maxime.boissonneault@
calculquebec.ca> wrote:
> Hi Alexi and all,
> We do this for Compute Canada. To do this, we add the following to our
> modules :
>
> prepend_path("MODULEPATH", "/cvmfs/soft.computecanada.ca/
> easybuild/modules/2017/avx2/MPI/intel2016.4/openmpi2.1")
> if isDir(pathJoin(os.getenv("HOME"), ".local/easybuild/modules/2017
> /avx2/MPI/intel2016.4/openmpi2.1")) then
> prepend_path("MODULEPATH", pathJoin(os.getenv("HOME"),
> ".local/easybuild/modules/2017/avx2/MPI/intel2016.4/openmpi2.1"))
> end
>
>
> If a user runs "eb" as itself, it will install ~/.local/easybuild as the
> easybuild directory.
>
> Maxime
>
>
> On 17-10-13 11:01, Alexi Rivera wrote:
>
> Hello Alan,
> and thank you for your answer.
>
> I have read the use case but didn't really reach a conclusion to an issue
> that I got.
>
> I did get the dependencies needed from our global tree, but I ran into an
> issue.
>
> We are using a hierarchial module naming system and when loading e.g. the
> foss module it will only add the system path, never my local path
> ~/.local/easybuild/modules/all/MPI/GCC/...
> So even if it does build the dependencies needed and install them to my
> local path, it is not able to load them when it builds the actual module
> that I want.
>
> Best regards,
> Alexi
> On 10/12/2017 05:53 PM, Alan O'Cais wrote:
>
> Dear Alexei,
>
> There is a long discussion about this use case in
> https://github.com/easybuilders/easybuild-framework/issues/2143 and how
> to do it.
>
> In a hierarchical scheme you would have to rebuild any modules you have
> that extend the path setting (with EASYBUILD_SUBDIR_USER_MODULES set).
> You also need to tell EasyBuild to look in both module trees, I did this
> with an alias in a dedicated lua module:
> set_alias("eb","env MODULEPATH=".."/path/to/global/module/tree/ending/in/
> *modules/all*"..':$MODULEPATH eb')
>
> Kind regards,
>
> Alan
>
> On 12 October 2017 at 16:45, Alexi Rivera <[email protected]>
> wrote:
>
>> Hello all,
>>
>> We are looking into allowing users on our cluster to build modules with
>> easybuild into their local directories.
>> However, it would be optimal if dependencies would be resolved against
>> the global installationdirectory that we use.
>>
>> That is, it seems that when installing to a new directory, you need to
>> build all dependencies again in this tree.
>> I'm thinking it will take up alot of unnecessary space if every user
>> needs to build every dependency separately.
>>
>> Is there a way to achieve what we're looking for?
>>
>> Best regards,
>> Alexi Rivera
>>
>>
>
>
> --
> Dr. Alan O'Cais
> E-CAM Software Manager
> Juelich Supercomputing Centre
> Forschungszentrum Juelich GmbH
> 52425 Juelich, Germany
>
> Phone: +49 2461 61 5213 <02461%20615213>
> Fax: +49 2461 61 6656 <02461%20616656>
> E-mail: [email protected]
> WWW: http://www.fz-juelich.de/ias/jsc/EN
>
>
> ------------------------------------------------------------
> ------------------------------------
> ------------------------------------------------------------
> ------------------------------------
> Forschungszentrum Juelich GmbH
> 52425 Juelich
> Sitz der Gesellschaft: Juelich
> Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
> Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher
> Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
> Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
> Prof. Dr. Sebastian M. Schmidt
> ------------------------------------------------------------
> ------------------------------------
> ------------------------------------------------------------
> ------------------------------------
>
>
>
> --
> ---------------------------------
> Maxime Boissonneault
> Analyste de calcul - Calcul Québec, Université Laval
> Président - Comité de coordination du soutien à la recherche de Calcul Québec
> Team lead - Research Support National Team, Compute Canada
> Instructeur Software Carpentry
> Ph. D. en physique
>
>
--
Dr. Alan O'Cais
E-CAM Software Manager
Juelich Supercomputing Centre
Forschungszentrum Juelich GmbH
52425 Juelich, Germany
Phone: +49 2461 61 5213 <02461%20615213>
Fax: +49 2461 61 6656 <02461%20616656>
E-mail: [email protected]
WWW: http://www.fz-juelich.de/ias/jsc/EN
