Re: [easybuild] install dir on gpfs

[Jack Perdue]

e.g.

$ cat /sw/hprc/mods/all/EasyBuild-terra/0.lua
whatis([[Description: EasyBuild environment for terra.tamu.edu]])

if (mode() == "load") then
  if ( not (isloaded("EasyBuild") ) ) then
load ("EasyBuild")
  end
end
pushenv("EASYBUILD_PREFIX","/sw/eb")
pushenv("EASYBUILD_BUILDPATH","/tmp/"..os.getenv("USER").."/easybuild/")
pushenv("EASYBUILD_DEPRECATED","2.0")
pushenv("EASYBUILD_INCLUDE_EASYBLOCKS", 
"/sw/eb/hprc/ec-dev/easyblocks/*.py")

pushenv("EASYBUILD_INSTALLPATH_MODULES", "/sw/eb/mods")
pushenv("EASYBUILD_INSTALLPATH_SOFTWARE", "/sw/eb/sw")
pushenv("EASYBUILD_MINIMAL_TOOLCHAINS", "1")
pushenv("EASYBUILD_MODULES_TOOL","Lmod")
pushenv("EASYBUILD_READ_ONLY_INSTALLDIR", "1")
pushenv("EASYBUILD_REPOSITORYPATH","/sw/eb/ebfiles_repo/terra")
pushenv("EASYBUILD_ROBOT","/sw/eb/ebfiles_repo_cleaned/terra")
pushenv("EASYBUILD_SOURCEPATH","/sw/eb/sources")
pushenv("EASYBUILD_TMPDIR","/tmp/"..os.getenv("USER").."/tmp/")
pushenv("EASYBUILD_TMP_LOGDIR","/tmp/"..os.getenv("USER").."/logs/")
-- pushenv("EASYBUILD_USE_EXISTING_MODULES", "1")
pushenv("LMOD_IGNORE_CACHE","1")
pushenv("INTEL_LICENSE_FILE","/sw/hprc/local/etc/licenses/intel")
pushenv("EB_ANSYS_LICENSE_SERVER", "hprc-license.tamu.edu")
pushenv("EB_ANSYS_LICENSE_SERVER_PORT", "2325:1055")
pushenv("PGROUPD_LICENSE_FILE", 
"/sw/hprc/local/etc/licenses/PGI/license.dat")

help([[
Easybuild environment for terra.tamu.edu
]])


On 06/20/2017 04:30 PM, Jack Perdue wrote:


We have three clusters running off of three
GSS/GPFS storage systems (one serving two
clusters and two serving the other cluster).

Haven't seen issues with using EasyBuild
on  GPFS here.  However, I do use:

EASYBUILD_TMPDIR=/tmp/j-perdue/tmp/
EASYBUILD_BUILDPATH=/tmp/j-perdue/easybuild/
EASYBUILD_TMP_LOGDIR=/tmp/j-perdue/logs/

while building so that might matter (I don't
build on GPFS too much traffic too slow).

Jack Perdue
Lead Systems Administrator
High Performance Research Computing
TAMU Division of Research
j-per...@tamu.eduhttp://hprc.tamu.edu
HPRC Helpdesk: h...@hprc.tamu.edu

On 06/20/2017 04:13 PM, Heywood, Todd wrote:
P.p.s I just noticed the issue does not occur for GCC/4.9.2 but does 
occur for GCC/4.9.3-2.25. This is consistent.



heywood@bnbmgmt2:~/tmp$ module --ignore_cache av

Rebuilding cache, please wait ... (written to file) done.


-- 
/sonas-hs/it/hpc/home/easybuild/install_prod/modules/all/Core 
---


GCC/4.4.6GCC/4.9.3-binutils-2.25 
GNU/4.9.3-2.25foss/2015a 
gompi/1.4.10-opt-hpcgompi/2015b


GCC/4.8.3 (D)GCC/4.9.3-2.25 
SRA-Toolkit/2.8.1-3-centos_linux64foss/2015b 
gompi/2014b  (D)gompi/2016a


GCC/4.9.2GCCcore/4.9.3 foss/2014b 
(D)foss/2016a gompi/2015a goolf/1.4.10-opt-hpc



   Where:

(D):  Default Module


Use "module spider" to find all possible modules.

Use "module keyword key1 key2 ..." to search for all possible modules 
matching any of the "keys".



heywood@bnbmgmt2:~/tmp$ module load GCC/4.9.2

heywood@bnbmgmt2:~/tmp$ g++ hello.cpp ; file a.out

a.out: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), 
dynamically linked (uses shared libs), for GNU/Linux 2.6.18, not 
stripped


heywood@bnbmgmt2:~/tmp$ module load GCC/4.9.3-2.25

heywood@bnbmgmt2:~/tmp$ g++ hello.cpp ; file a.out

a.out: data

heywood@bnbmgmt2:~/tmp$

From: Todd Heywood >
Date: Tuesday, June 20, 2017 at 5:04 PM
To: "easybuild@lists.ugent.be" 
>

Subject: Re: [easybuild] install dir on gpfs

P.s. This issue does NOT occur if using g++  from a GCC built outside 
of the Easybuild framework.



From: 
> 
on behalf of Todd Heywood >
Reply-To: "easybuild@lists.ugent.be" 
>

Date: Tuesday, June 20, 2017 at 4:52 PM
To: "easybuild@lists.ugent.be" 
>

Subject: [easybuild] install dir on gpfs

Has anyone installed easybuild on GPFS, not NFS? We just migrated our 
easybuild installation to GPFS, and now when we use an 
Easybuild-built compiler to build software (on GPFS), the “configure” 
step fails when tests the compiler to create an executable, and tests 
whether the executable works. You can see the issue here:



xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; ./a.out

-bash: ./a.out: cannot execute binary file

xyz@bnbmgmt2:~/tmp$ ./a.out # it work a couple seconds later

Hello World!heywood@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; file a.out

a.out: data

xyz@bnbmgmt2:~/tmp$ 

Re: [easybuild] install dir on gpfs

[Vanzo, Davide]

Todd,

We have all EasyBuild built software on GPFS and I have never experienced that 
kind of issue.
Unfortunately I do not have any suggestion on where to start looking at since I 
am not much a storage expert.

--
Davide Vanzo, PhD
Application Developer
Advanced Computing Center for Research and Education (ACCRE)
Vanderbilt University - Hill Center 201
(615)-875-9137
www.accre.vanderbilt.edu

On Jun 20 2017, at 4:07 pm, Heywood, Todd  wrote:

P.s. This issue does NOT occur if using g++ from a GCC built outside of the 
Easybuild framework.

From: 
> on 
behalf of Todd Heywood >
Reply-To: "easybuild@lists.ugent.be" 
>
Date: Tuesday, June 20, 2017 at 4:52 PM
To: "easybuild@lists.ugent.be" 
>
Subject: [easybuild] install dir on gpfs

Has anyone installed easybuild on GPFS, not NFS? We just migrated our easybuild 
installation to GPFS, and now when we use an Easybuild-built compiler to build 
software (on GPFS), the “configure” step fails when tests the compiler to 
create an executable, and tests whether the executable works. You can see the 
issue here:

xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; ./a.out

-bash: ./a.out: cannot execute binary file

xyz@bnbmgmt2:~/tmp$ ./a.out # it work a couple seconds later

Hello World!heywood@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; file a.out

a.out: data

xyz@bnbmgmt2:~/tmp$ file a.out # gives expected output a couple seconds later

a.out: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked 
(uses shared libs), for GNU/Linux 2.6.18, not stripped

xyz@bnbmgmt2:~/tmp$

Thanks,

T

Re: [easybuild] install dir on gpfs

[Heywood, Todd]

P.s. This issue does NOT occur if using g++  from a GCC built outside of the 
Easybuild framework.


From: 
> on 
behalf of Todd Heywood >
Reply-To: "easybuild@lists.ugent.be" 
>
Date: Tuesday, June 20, 2017 at 4:52 PM
To: "easybuild@lists.ugent.be" 
>
Subject: [easybuild] install dir on gpfs

Has anyone installed easybuild on GPFS, not NFS? We just migrated our easybuild 
installation to GPFS, and now when we use an Easybuild-built compiler to build 
software (on GPFS), the “configure” step fails when tests the compiler to 
create an executable, and tests whether the executable works. You can see the 
issue here:


xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; ./a.out

-bash: ./a.out: cannot execute binary file

xyz@bnbmgmt2:~/tmp$ ./a.out # it work a couple seconds later

Hello World!heywood@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; file a.out

a.out: data

xyz@bnbmgmt2:~/tmp$ file a.out # gives expected output a couple seconds later

a.out: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked 
(uses shared libs), for GNU/Linux 2.6.18, not stripped

xyz@bnbmgmt2:~/tmp$

Thanks,

T

[easybuild] install dir on gpfs

[Heywood, Todd]

Has anyone installed easybuild on GPFS, not NFS? We just migrated our easybuild 
installation to GPFS, and now when we use an Easybuild-built compiler to build 
software (on GPFS), the “configure” step fails when tests the compiler to 
create an executable, and tests whether the executable works. You can see the 
issue here:


xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; ./a.out

-bash: ./a.out: cannot execute binary file

xyz@bnbmgmt2:~/tmp$ ./a.out # it work a couple seconds later

Hello World!heywood@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$

xyz@bnbmgmt2:~/tmp$ g++ hello.cpp ; file a.out

a.out: data

xyz@bnbmgmt2:~/tmp$ file a.out # gives expected output a couple seconds later

a.out: ELF 64-bit LSB executable, x86-64, version 1 (SYSV), dynamically linked 
(uses shared libs), for GNU/Linux 2.6.18, not stripped

xyz@bnbmgmt2:~/tmp$

Thanks,

T

[easybuild] next EasyBuild conf call: Wed June 21st 2017, 5pm CET

[Kenneth Hoste]

Dear EasyBuilders,

The next EasyBuild conf call is planned for tomorrow, Wed June 21st, 5pm 
CET; see also https://plus.google.com/events/c9ruvk8f4vtpuirlo04pmlg0ghc .


Current agenda:

* outlook to EasyBuild v3.3.0
* moving EasyBuild repositories to https://github.com/easybuilders 
organization

* 2017b toolchains
* Q

Suggestions for additional topics are welcome.

More information about the EasyBuild conf calls is available at 
https://github.com/hpcugent/easybuild/wiki/Conference-calls.



regards,

Kenneth