I get the following error when trying to run SHMEM programs using UCX.
[xiii@shini dir]$ oshrun -n 1 ./target/debug/main
[1556046469.890238] [shini:19769:0]sys.c:619 UCX ERROR
shmget(size=2097152 flags=0xfb0) for mm_recv_desc failed: Operation not
permitted, please check shared memory limits by 'ipcs -l'
[1556046469.895859] [shini:19769:0]sys.c:619 UCX ERROR
shmget(size=2097152 flags=0xfb0) for mm_recv_desc failed: Operation not
permitted, please check shared memory limits by 'ipcs -l'
[1556046469.899577] [shini:19769:0]sys.c:619 UCX ERROR
shmget(size=270532608 flags=0xfb0) for user allocation failed: Operation
not permitted, please check shared memory limits by 'ipcs -l'
As far as I can tell, the programs I'm running are not actually resource
constrained, and `ipcs -l` seems to indicate there's plenty of available
shared memory. Other than this error, my code seems to run normally.
[xiii@shini dir]$ ipcs -l
-- Messages Limits
max queues system wide = 32000
max size of message (bytes) = 8192
default max size of queue (bytes) = 16384
-- Shared Memory Limits
max number of segments = 4096
max seg size (kbytes) = 18014398509465599
max total shared memory (kbytes) = 18014398509481980
min seg size (bytes) = 1
-- Semaphore Limits
max number of arrays = 32000
max semaphores per array = 32000
max semaphores system wide = 102400
max ops per semop call = 500
semaphore max value = 32767
Do you know what's causing this / if I need to worry about it / how I can
fix this error?
Thanks,
Ben
___
users mailing list
users@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/users
