Hi !
We are running on a RH7.2 (apology for the typo ..)
This is what I get:
[easybuild@nd48:~]$ rpm -qf /usr/include/infiniband/verbs.h
libibverbs-devel-1.1.8mlnx1-OFED.3.3.0.0.9.33100.x86_64
[easybuild@nd48:~]$ grep IBV_ACCESS_ON_DEMAND
/usr/include/infiniband/verbs.h
[easybuild@nd48:~]$
Soi...there is no entry for IBV_ACCESS_ON_DEMAND
[easybuild@nd48:~]$ grep IBV_ACCESS /usr/include/infiniband/verbs.h
*IBV_ACCESS*_LOCAL_WRITE = 1,
*IBV_ACCESS*_REMOTE_WRITE = (1<<1),
*IBV_ACCESS*_REMOTE_READ = (1<<2),
*IBV_ACCESS*_REMOTE_ATOMIC = (1<<3),
*IBV_ACCESS*_MW_BIND = (1<<4)
Thank you !
quim
Missatge de Bart Oldeman <[email protected]> del dia dv., 15 de
març 2024 a les 12:45:
> Hi,
>
> On 7.9 it's defined here:
> $ rpm -qf /usr/include/infiniband/verbs.h
> rdma-core-devel-22.4-6.el7_9.x86_64
>
> $ grep IBV_ACCESS_ON_DEMAND /usr/include/infiniband/verbs.h
> IBV_ACCESS_ON_DEMAND = (1<<6),
>
> if you have MOFED it would be somewhere else, not sure.
>
> Le jeu. 14 mars 2024, à 11 h 03, Joaquim Jornet Somoza
> <[email protected]> a écrit :
> >
> > Dear easybuilders,
> >
> > I am trying to install foss-2023a.eb on a RH7.7 servers, but when
> installing UCX-1.14.1-GCCcore-12.3.0.eb , the installation fails with the
> following error:
> > ...
> > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. "-DCPU_FLAGS=|avx"
> -I/dev/shm/easybuild/UCX/1.14.1/GCCcore-12.3.0/ucx-1.14.1/src
> -I/dev/shm/easybuild/UCX/1.14.1/GCCcore-12.3.0/ucx-1.14.1
> -I/dev/shm/easybuild/UCX/1.14.1/GCCcore-12.3.0/ucx-1.14.1/src
> -I/software/easybuild/x86_64/software/numactl/2.0.16-GCCcore-12.3.0/include
> -I/software/easybuild/x86_64/software/zlib/1.2.13-GCCcore-12.3.0/include
> -I/software/easybuild/x86_64/software/pkgconf/1.9.5-GCCcore-12.3.0/include
> -I/software/easybuild/x86_64/software/binutils/2.40-GCCcore-12.3.0/include
> -O3 -g -Wall -Werror -mavx -funwind-tables -Wno-missing-field-initializers
> -Wno-unused-parameter -Wno-unused-label -Wno-long-long -Wno-endif-labels
> -Wno-sign-compare -Wno-multichar -Wno-deprecated-declarations -Winvalid-pch
> -Wno-pointer-sign -Werror-implicit-function-declaration
> -Wno-format-zero-length -Wnested-externs -Wshadow
> -Werror=declaration-after-statement -O2 -ftree-vectorize -march=native
> -fno-math-errno -fPIC -MT rc/verbs/libuct_ib_la-rc_verbs_ep.lo -MD -MP -MF
> rc/verbs/.deps/libuct_ib_la-rc_verbs_ep.Tpo -c rc/verbs/rc_verbs_ep.c -o
> rc/verbs/libuct_ib_la-rc_verbs_ep.o >/dev/null 2>&1
> > base/ib_md.c: In function 'uct_ib_md_access_flags':
> > base/ib_md.c:638:25: error: 'IBV_ACCESS_ON_DEMAND' undeclared (first use
> in this function); did you mean 'IBV_EXP_ACCESS_ON_DEMAND'?
> > 638 | access_flags |= IBV_ACCESS_ON_DEMAND;
> > | ^~~~~~~~~~~~~~~~~~~~
> > | IBV_EXP_ACCESS_ON_DEMAND
> > base/ib_md.c:638:25: note: each undeclared identifier is reported only
> once for each function it appears in
> > base/ib_md.c: In function 'uct_ib_mem_reg_internal':
> > base/ib_md.c:751:24: error: 'IBV_ACCESS_ON_DEMAND' undeclared (first use
> in this function); did you mean 'IBV_EXP_ACCESS_ON_DEMAND'?
> > 751 | if (access_flags & IBV_ACCESS_ON_DEMAND) {
> > | ^~~~~~~~~~~~~~~~~~~~
> > | IBV_EXP_ACCESS_ON_DEMAND
> > base/ib_md.c: In function 'uct_ib_md_global_odp_init':
> > base/ib_md.c:1449:54: error: 'IBV_ACCESS_ON_DEMAND' undeclared (first
> use in this function); did you mean 'IBV_EXP_ACCESS_ON_DEMAND'?
> > 1449 | UCT_IB_MEM_ACCESS_FLAGS |
> IBV_ACCESS_ON_DEMAND,
> > |
> ^~~~~~~~~~~~~~~~~~~~
> > |
> IBV_EXP_ACCESS_ON_DEMAND
> >
> >
> > Any hint on how to fix it? Is there a bug with IBV_ACCESS_ON_DEMAND
> variable?
> >
> > Thank you !
> >
> > Best regards
> > quim
> > --
> >
> ----------------------------------------------------------------------------------------------------------------------------------------
> > Dr. Joaquim Jornet Somoza
> > Técnico Superior de Cálculo Científico
> > Servicios Generales a la Investigación (SGIker)
> > Universidad del País Vasco (UPV/EHU)
> > email: [email protected]
> > Edificio Joxe Maria Korta (Campus Gipuzkoa)
> > Av. Tolosa 72, 4a planta
> > 20018 Donostia-San Sebastián,
> > Gipuzkoa, Spain
> >
> > External Collaborator.
> > Nano-Bio Spectroscopy group
> > Departamento de Física de Materiales
> > Universidad del País Vasco (UPV/EHU)
> > Donostia-San Sebastián, Gipuzkoa, Spain
> >
> > The Max Planck Institute for the Structure and Dynamics of Matter (MPSD)
> > Bldg. 99 (CFEL)
> > Luruper Chaussee 149
> > 22761 Hamburg, Germany
>
>
>
> --
> Bart E. Oldeman, Ph.D. | [email protected] |
> [email protected]
> Scientific Analyst / Analyste scientifique
> McGill HPC Centre / Centre de Calcul Haute Performance de McGill
> Calcul Québec | https://www.calculquebec.ca
> Digital Research Alliance of / Alliance de recherche numérique du
> Canada | https://www.alliancecan.ca
> T: 514-396-8926
>
--
----------------------------------------------------------------------------------------------------------------------------------------
*Dr. Joaquim Jornet Somoza*
*Técnico Superior de Cálculo Científico *
Servicios Generales a la Investigación (*SGIker*)
Universidad del País Vasco (*UPV/EHU*)
email: [email protected]
Edificio Joxe Maria Korta (Campus Gipuzkoa)
Av. Tolosa 72, 4a planta
20018 Donostia-San Sebastián,
Gipuzkoa, Spain
*External Collaborator.*
Nano-Bio Spectroscopy group
Departamento de Física de Materiales
Universidad del País Vasco (UPV/EHU)
Donostia-San Sebastián, Gipuzkoa, Spain
The Max Planck Institute for the Structure and Dynamics of Matter (MPSD)
Bldg. 99 (CFEL)
Luruper Chaussee 149
22761 Hamburg, Germany
