Re: [OMPI devel] [EXTERNAL] ibarrier failures on MTT

2012-07-05 Thread Barrett, Brian W
On 7/3/12 5:08 PM, "Eugene Loh" wrote: >I'll look at this more, but for now I'll just note that the new ibarrier >test is showing lots of failures on MTT (cisco and oracle). I was initializing the MPI_ERROR field of the request status after calling the request completion

Re: [OMPI devel] SM component init unload

2012-07-05 Thread Ralph Castain
George: is there any reason for opening and selecting the coll framework so early in mpi_init? I'm wondering if we can move that code to the end of the procedure so we wouldn't need the locality info until later. Sent from my iPad On Jul 5, 2012, at 10:05 AM, Jeff Squyres

Re: [OMPI devel] openib max_cqe

2012-07-05 Thread Shamis, Pavel
>> I mentioned on the call that for Mellanox devices (+OFA verbs) this resource >> is really cheap. Do you run mellanox hca + OFA verbs ? > > (I'll reply because I know Terry is offline for the rest of the day) > > Yes, he does. I asked because SUN used to have own verbs driver. > > The

Re: [OMPI devel] openib max_cqe

2012-07-05 Thread Jeff Squyres
On Jul 5, 2012, at 3:53 PM, Shamis, Pavel wrote: > I mentioned on the call that for Mellanox devices (+OFA verbs) this resource > is really cheap. Do you run mellanox hca + OFA verbs ? (I'll reply because I know Terry is offline for the rest of the day) Yes, he does. The heart of the

Re: [OMPI devel] openib max_cqe

2012-07-05 Thread Shamis, Pavel
> So if I do a run of -np 2 across two separate node than the use of the > max_cqe of my ib device (4194303) is ok. Once I go beyond 1 process on the > node I start getting the memlocked limits message. So how much memory does a > cqe take? Is it 1k by any chance? I ask this because the

[OMPI devel] openib max_cqe

2012-07-05 Thread TERRY DONTJE
With Jeff's latest changes to how we set up the cq_size I am now seeing error messages saying that my machine's memlocked limits are too low. I am concerned that it might be something else because my max'd locked memory is unlimited on my machine. So if I do a run of -np 2 across two

Re: [OMPI devel] SM component init unload

2012-07-05 Thread Jeff Squyres
Thanks George. I filed https://svn.open-mpi.org/trac/ompi/ticket/3162 about this. On Jul 4, 2012, at 5:34 AM, Juan A. Rico wrote: > Thanks all of you for your time and early responses. > > After applying the patch, SM can be used by raising its priority. It is > enough for me (I hope so).