"Lane, William" writes:
> Ralph,
>
> For the following openMPI job submission:
>
> qsub -q short.q -V -pe make 84 -b y mpirun -np 84 --prefix
> /hpc/apps/mpi/openmpi/1.10.1/ --hetero-nodes --mca btl ^sm --mca
> plm_base_verbose 5 /hpc/home/lanew/mpi/openmpi/a_1_10_1.out
>
> I have some more infor
limit of 4096. All
> compute nodes have a hard/soft open files limit of 4096.
>
> -Bill L.
>
> From: users [users-boun...@open-mpi.org] on behalf of Ralph Castain
> [r...@open-mpi.org]
> Sent: Thursday, March 17, 2016 6:02 PM
> To: Open MPI Users
> Subject: Re: [OMP
ers [users-boun...@open-mpi.org] on behalf of Ralph Castain
[r...@open-mpi.org]
Sent: Thursday, March 17, 2016 6:02 PM
To: Open MPI Users
Subject: Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >=
4096 still required?
Yeah, it looks like something is wrong with the mmap bac
1.out[0x400999]
> [csclprd3-6-12:30667] *** End of error message ***
>
> -Bill L.
>
> From: users [users-boun...@open-mpi.org <mailto:users-boun...@open-mpi.org>]
> on behalf of Lane, William [william.l...@cshs.org
> <mailto:william.l...@cshs.org>]
> Sent: Thur
m.l...@cshs.org]
Sent: Thursday, March 17, 2016 4:49 PM
To: Open MPI Users
Subject: Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >=
4096 still required?
I apologize Ralph, I forgot to include my command line for invoking OpenMPI on
SoGE:
qsub -q short.q -V -pe make 87
] OpenMPI 1.10.1 *ix hard/soft open files limits >=
4096 still required?
No, that shouldn’t be the issue any more - and that isn’t what the backtrace
indicates. It looks instead like there was a problem with the shared memory
backing file on a remote node, and that caused the vader shared mem
No, that shouldn’t be the issue any more - and that isn’t what the backtrace
indicates. It looks instead like there was a problem with the shared memory
backing file on a remote node, and that caused the vader shared memory BTL to
segfault.
Try turning vader off and see if that helps - I’m not
I remember years ago, OpenMPI (version 1.3.3) required the hard/soft open
files limits be >= 4096 in order to function when large numbers of slots
were requested (with 1.3.3 this was at roughly 85 slots). Is this requirement
still present for OpenMPI versions 1.10.1 and greater?
I'm having some is