Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required?

2016-03-21 Thread Dave Love
"Lane, William" writes: > Ralph, > > For the following openMPI job submission: > > qsub -q short.q -V -pe make 84 -b y mpirun -np 84 --prefix > /hpc/apps/mpi/openmpi/1.10.1/ --hetero-nodes --mca btl ^sm --mca > plm_base_verbose 5 /hpc/home/lanew/mpi/openmpi/a_1_10_1.out >

Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required?

2016-03-18 Thread Lane, William
ers [users-boun...@open-mpi.org] on behalf of Ralph Castain [r...@open-mpi.org] Sent: Thursday, March 17, 2016 6:02 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required? Yeah, it looks like something is wrong with the mmap bac

Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required?

2016-03-17 Thread Ralph Castain
new/mpi/openmpi/a_1_10_1.out[0x400999] > [csclprd3-6-12:30667] *** End of error message *** > > -Bill L. > > From: users [users-boun...@open-mpi.org <mailto:users-boun...@open-mpi.org>] > on behalf of Lane, William [william.l...@cshs.org > <mailto:william.l...@c

Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required?

2016-03-17 Thread Lane, William
.@cshs.org] Sent: Thursday, March 17, 2016 4:49 PM To: Open MPI Users Subject: Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required? I apologize Ralph, I forgot to include my command line for invoking OpenMPI on SoGE: qsub -q short.q -V -pe make 87 -b y

Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required?

2016-03-17 Thread Lane, William
] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required? No, that shouldn’t be the issue any more - and that isn’t what the backtrace indicates. It looks instead like there was a problem with the shared memory backing file on a remote node, and that caused the vader shared mem

Re: [OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required?

2016-03-17 Thread Ralph Castain
No, that shouldn’t be the issue any more - and that isn’t what the backtrace indicates. It looks instead like there was a problem with the shared memory backing file on a remote node, and that caused the vader shared memory BTL to segfault. Try turning vader off and see if that helps - I’m not

[OMPI users] OpenMPI 1.10.1 *ix hard/soft open files limits >= 4096 still required?

2016-03-17 Thread Lane, William
I remember years ago, OpenMPI (version 1.3.3) required the hard/soft open files limits be >= 4096 in order to function when large numbers of slots were requested (with 1.3.3 this was at roughly 85 slots). Is this requirement still present for OpenMPI versions 1.10.1 and greater? I'm having some