Well, RH7 is deprecated, and that's an OFED 3.3 stack. They (UCX devs) probably didn't even come close to developing on something that old.
So IBV_ACCESS_ON_DEMAND doesn't exist in that old distro. I strongly suggest updating, either both OS and OFED stack or just upgrade to the latest MOFED stack supported on that OS ________________________________________ From: [email protected] <[email protected]> on behalf of Joaquim Jornet Somoza <[email protected]> Sent: Friday, March 15, 2024 12:49 To: [email protected] Subject: Re: [easybuild] Failure in UCX-1.14.1-GCCcore-12.3.0.eb when installing foss-2023a.eb Hi ! We are running on a RH7.2 (apology for the typo ..) This is what I get: [easybuild@nd48:~]$ rpm -qf /usr/include/infiniband/verbs.h libibverbs-devel-1.1.8mlnx1-OFED.3.3.0.0.9.33100.x86_64 [easybuild@nd48:~]$ grep IBV_ACCESS_ON_DEMAND /usr/include/infiniband/verbs.h [easybuild@nd48:~]$ Soi...there is no entry for IBV_ACCESS_ON_DEMAND [easybuild@nd48:~]$ grep IBV_ACCESS /usr/include/infiniband/verbs.h IBV_ACCESS_LOCAL_WRITE = 1, IBV_ACCESS_REMOTE_WRITE = (1<<1), IBV_ACCESS_REMOTE_READ = (1<<2), IBV_ACCESS_REMOTE_ATOMIC = (1<<3), IBV_ACCESS_MW_BIND = (1<<4) Thank you ! quim Missatge de Bart Oldeman <[email protected]<mailto:[email protected]>> del dia dv., 15 de març 2024 a les 12:45: Hi, On 7.9 it's defined here: $ rpm -qf /usr/include/infiniband/verbs.h rdma-core-devel-22.4-6.el7_9.x86_64 $ grep IBV_ACCESS_ON_DEMAND /usr/include/infiniband/verbs.h IBV_ACCESS_ON_DEMAND = (1<<6), if you have MOFED it would be somewhere else, not sure. Le jeu. 14 mars 2024, à 11 h 03, Joaquim Jornet Somoza <[email protected]<mailto:[email protected]>> a écrit : > > Dear easybuilders, > > I am trying to install foss-2023a.eb on a RH7.7 servers, but when installing > UCX-1.14.1-GCCcore-12.3.0.eb , the installation fails with the following > error: > ... > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. "-DCPU_FLAGS=|avx" > -I/dev/shm/easybuild/UCX/1.14.1/GCCcore-12.3.0/ucx-1.14.1/src > -I/dev/shm/easybuild/UCX/1.14.1/GCCcore-12.3.0/ucx-1.14.1 > -I/dev/shm/easybuild/UCX/1.14.1/GCCcore-12.3.0/ucx-1.14.1/src > -I/software/easybuild/x86_64/software/numactl/2.0.16-GCCcore-12.3.0/include > -I/software/easybuild/x86_64/software/zlib/1.2.13-GCCcore-12.3.0/include > -I/software/easybuild/x86_64/software/pkgconf/1.9.5-GCCcore-12.3.0/include > -I/software/easybuild/x86_64/software/binutils/2.40-GCCcore-12.3.0/include > -O3 -g -Wall -Werror -mavx -funwind-tables -Wno-missing-field-initializers > -Wno-unused-parameter -Wno-unused-label -Wno-long-long -Wno-endif-labels > -Wno-sign-compare -Wno-multichar -Wno-deprecated-declarations -Winvalid-pch > -Wno-pointer-sign -Werror-implicit-function-declaration > -Wno-format-zero-length -Wnested-externs -Wshadow > -Werror=declaration-after-statement -O2 -ftree-vectorize -march=native > -fno-math-errno -fPIC -MT rc/verbs/libuct_ib_la-rc_verbs_ep.lo -MD -MP -MF > rc/verbs/.deps/libuct_ib_la-rc_verbs_ep.Tpo -c rc/verbs/rc_verbs_ep.c -o > rc/verbs/libuct_ib_la-rc_verbs_ep.o >/dev/null 2>&1 > base/ib_md.c: In function 'uct_ib_md_access_flags': > base/ib_md.c:638:25: error: 'IBV_ACCESS_ON_DEMAND' undeclared (first use in > this function); did you mean 'IBV_EXP_ACCESS_ON_DEMAND'? > 638 | access_flags |= IBV_ACCESS_ON_DEMAND; > | ^~~~~~~~~~~~~~~~~~~~ > | IBV_EXP_ACCESS_ON_DEMAND > base/ib_md.c:638:25: note: each undeclared identifier is reported only once > for each function it appears in > base/ib_md.c: In function 'uct_ib_mem_reg_internal': > base/ib_md.c:751:24: error: 'IBV_ACCESS_ON_DEMAND' undeclared (first use in > this function); did you mean 'IBV_EXP_ACCESS_ON_DEMAND'? > 751 | if (access_flags & IBV_ACCESS_ON_DEMAND) { > | ^~~~~~~~~~~~~~~~~~~~ > | IBV_EXP_ACCESS_ON_DEMAND > base/ib_md.c: In function 'uct_ib_md_global_odp_init': > base/ib_md.c:1449:54: error: 'IBV_ACCESS_ON_DEMAND' undeclared (first use in > this function); did you mean 'IBV_EXP_ACCESS_ON_DEMAND'? > 1449 | UCT_IB_MEM_ACCESS_FLAGS | > IBV_ACCESS_ON_DEMAND, > | > ^~~~~~~~~~~~~~~~~~~~ > | > IBV_EXP_ACCESS_ON_DEMAND > > > Any hint on how to fix it? Is there a bug with IBV_ACCESS_ON_DEMAND variable? > > Thank you ! > > Best regards > quim > -- > ---------------------------------------------------------------------------------------------------------------------------------------- > Dr. Joaquim Jornet Somoza > Técnico Superior de Cálculo Científico > Servicios Generales a la Investigación (SGIker) > Universidad del País Vasco (UPV/EHU) > email: [email protected]<mailto:[email protected]> > Edificio Joxe Maria Korta (Campus Gipuzkoa) > Av. Tolosa 72, 4a planta > 20018 Donostia-San Sebastián, > Gipuzkoa, Spain > > External Collaborator. > Nano-Bio Spectroscopy group > Departamento de Física de Materiales > Universidad del País Vasco (UPV/EHU) > Donostia-San Sebastián, Gipuzkoa, Spain > > The Max Planck Institute for the Structure and Dynamics of Matter (MPSD) > Bldg. 99 (CFEL) > Luruper Chaussee 149 > 22761 Hamburg, Germany -- Bart E. Oldeman, Ph.D. | [email protected]<mailto:[email protected]> | [email protected]<mailto:[email protected]> Scientific Analyst / Analyste scientifique McGill HPC Centre / Centre de Calcul Haute Performance de McGill Calcul Québec | https://www.calculquebec.ca<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.calculquebec.ca%2F&data=05%7C02%7Cake.sandgren%40umu.se%7C61938ad2f50a417028c708dc44e6333e%7C5a4ba6f9f5314f329467398f19e69de4%7C0%7C0%7C638461002692743892%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=UIB1ACmUQF2D1NdTTYpR1%2F1GvFIkPKKpWMr8xLT00xc%3D&reserved=0> Digital Research Alliance of / Alliance de recherche numérique du Canada | https://www.alliancecan.ca<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.alliancecan.ca%2F&data=05%7C02%7Cake.sandgren%40umu.se%7C61938ad2f50a417028c708dc44e6333e%7C5a4ba6f9f5314f329467398f19e69de4%7C0%7C0%7C638461002692753029%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=hIjeKNgPqfX76xIk1J9AOVlBYhNxJtmp0n0gx20tRn4%3D&reserved=0> T: 514-396-8926 -- ---------------------------------------------------------------------------------------------------------------------------------------- Dr. Joaquim Jornet Somoza Técnico Superior de Cálculo Científico Servicios Generales a la Investigación (SGIker) Universidad del País Vasco (UPV/EHU) email: [email protected]<mailto:[email protected]> Edificio Joxe Maria Korta (Campus Gipuzkoa) Av. Tolosa 72, 4a planta 20018 Donostia-San Sebastián, Gipuzkoa, Spain External Collaborator. Nano-Bio Spectroscopy group Departamento de Física de Materiales Universidad del País Vasco (UPV/EHU) Donostia-San Sebastián, Gipuzkoa, Spain The Max Planck Institute for the Structure and Dynamics of Matter (MPSD) Bldg. 99 (CFEL) Luruper Chaussee 149 22761 Hamburg, Germany
