Any ideas about mpi errors on infiniband?
sge03:f52:a8c8d700: 1397 us(1397 us): open_hca: dev open failed for
mlx4_0, err=Permission denied
sge12:6162:17bd0700: 1523 us(1523 us): open_hca: dev open failed for
mlx4_0, err=Permission denied
ssh sge03 "ibnodes ; ibstatus"
Ca : 0x0002c90300ec37e0 ports 2 "sge12 mlx4_0"
Ca : 0x0002c90300ec39c0 ports 2 "sge03 mlx4_0"
Switch : 0x0002c903009683d0 ports 36 "SwitchX - Mellanox Technologies"
base port 0 lid 7 lmc 0
Infiniband device 'mlx4_0' port 1 status:
default gid: fe80:0000:0000:0000:0002:c903:00ec:39c1
base lid: 0x0
sm lid: 0x0
state: 1: DOWN
phys state: 3: Disabled
rate: 40 Gb/sec (4X QDR)
Infiniband device 'mlx4_0' port 2 status:
default gid: fe80:0000:0000:0000:0002:c903:00ec:39c2
base lid: 0x1
sm lid: 0x6
state: 4: *ACTIVE*
phys state: 5: LinkUp
rate: 40 Gb/sec (4X FDR10)
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users
