Re: QoS settings not mapped correctly per pkey ?

2009-11-25 Thread Vincent Ficet
Hello Yevgeny, >>> OK, so there are three possible reasons that I can think of: >>> 1. Something is wrong in the configuration. >>> 2. The application does not saturate the link, thus QoS >>> and the whole VL arbitration thing doesn't kick in. >>> 3. There's some bug, somewhere. >>> >>> Let's st

Re: RDMAoE verbs questions

2009-11-25 Thread Or Gerlitz
Pavel Shamis (Pasha) wrote: The patch is attached Thanks, this patch basically replaces checks for the device transport type to be IB to a check that makes sure either the former happens or the port transport type is rdmaoe. As Jason, Tziporet and noted, the port transport type seems to be bad

Re: RDMAoE verbs questions

2009-11-25 Thread Pavel Shamis (Pasha)
Or, The patch is attached. Regards, Pasha. Or Gerlitz wrote: Jeff Squyres wrote: Here's one thread: http://www.open-mpi.org/community/lists/devel/2009/11/7063.php Jeff, looking on the threads you have sent, I didn't find a way to download the patch in a form which can be applied on a source

Re: Re: RDMAoE verbs questions

2009-11-25 Thread Jason Gunthorpe
On Wed, Nov 25, 2009 at 11:53:47AM +0200, Pavel Shamis (Pasha) wrote: > > >I think I'm asking you about the non RDMACM stuff in openmpi, ibcm, > >xoob, etc. I can't tell at glance if any of them will be safe to run > >on RDMAoE as-is.. > > > The oob and xoob are custom ompi mpi connection manage

Re: RDMAoE verbs questions

2009-11-25 Thread Jason Gunthorpe
On Wed, Nov 25, 2009 at 04:41:08PM +0200, Eli Cohen wrote: > On Wed, Nov 25, 2009 at 09:30:40AM -0500, Jeff Squyres wrote: > > > > In practice, we have seen that applications *do* need to query the > > transport type -- at least (real) IB vs. iWARP. It is your > > expectation that IB and IBoE wil

RE: [ANNOUNCE] OFED 1.5 rc3 release is available

2009-11-25 Thread Davis, Arlin R
>Subject: [ANNOUNCE] OFED 1.5 rc3 release is available > >OFED 1.5-rc3 is available > Vlad, What happened to the new uDAPL libraries released last night? I don't see them on the list. -arlin -- To unsubscribe from this list: send the line "unsubscribe linux-rdma" in the body of a message t

Re: Re: OFED-1.x SRP's user manual

2009-11-25 Thread Vu Pham
Pawel Dziekonski wrote: On Mon, 16 Nov 2009 at 05:39:45PM +0100, Pawel Dziekonski wrote: Hello, where do I find SRP user manual? There is no manual in OFED distro, I have also checked main website and wiki. Manual is mentioned in OFED/docs/SRPT_README.txt. Hello again. I got no answe

[patch 5/8] ehca - ib_post_recv fixes, Updated

2009-11-25 Thread frank zago
Always set ib_post_recv()'s bad_wr. Signed-off-by: Frank Zago Index: linux-2.6.31/drivers/infiniband/hw/ehca/ehca_reqs.c === --- linux-2.6.31.orig/drivers/infiniband/hw/ehca/ehca_reqs.c 2009-11-24 19:49:19.0 -0600 +++ linux

[patch 2/8] ehca - ib_post_send fixes, Updated

2009-11-25 Thread frank zago
Always set ib_post_send()'s bad_wr. Do not report success if an error occurred. Signed-off-by: Frank Zago Index: linux-2.6.31/drivers/infiniband/hw/ehca/ehca_reqs.c === --- linux-2.6.31.orig/drivers/infiniband/hw/ehca/ehca_reqs.c 20

Re: QoS settings not mapped correctly per pkey ?

2009-11-25 Thread Yevgeny Kliteynik
Vincent Ficet wrote: Yevgeny, OK, so there are three possible reasons that I can think of: 1. Something is wrong in the configuration. 2. The application does not saturate the link, thus QoS and the whole VL arbitration thing doesn't kick in. 3. There's some bug, somewhere. Let's start with r

Re: QoS settings not mapped correctly per pkey ?

2009-11-25 Thread Vincent Ficet
Yevgeny, > > OK, so there are three possible reasons that I can think of: > 1. Something is wrong in the configuration. > 2. The application does not saturate the link, thus QoS > and the whole VL arbitration thing doesn't kick in. > 3. There's some bug, somewhere. > > Let's start with reason no.

Re: RDMAoE verbs questions

2009-11-25 Thread Or Gerlitz
Jeff Squyres wrote: Here's one thread: http://www.open-mpi.org/community/lists/devel/2009/11/7063.php Jeff, looking on the threads you have sent, I didn't find a way to download the patch in a form which can be applied on a source tree, is there a way to do it through this archive? are these p

Re: RDMAoE verbs questions

2009-11-25 Thread Eli Cohen
On Wed, Nov 25, 2009 at 09:30:40AM -0500, Jeff Squyres wrote: > > In practice, we have seen that applications *do* need to query the > transport type -- at least (real) IB vs. iWARP. It is your > expectation that IB and IBoE will function identically? > > Can you discuss the "transport" vs. "tra

Re: QoS settings not mapped correctly per pkey ?

2009-11-25 Thread Yevgeny Kliteynik
Vincent Ficet wrote: Yevgeny, Hi Vincent, Vincent Ficet wrote: Hello, Following the QoS experiments I carried out yesterday, I wanted to set up 3 IP networks, each one bound to a particular pkey, in order to achieve QoS for each network. Unfortunately, it seems that something is not mapped p

Re: RDMAoE verbs questions

2009-11-25 Thread Jeff Squyres
On Nov 25, 2009, at 9:04 AM, Tziporet Koren wrote: Note that application does not need to query the transport type, but we thought it can be good to know also from debug perspective. Thus I think sysfs is the best place. In practice, we have seen that applications *do* need to query the

Re: OFED-1.x SRP's user manual

2009-11-25 Thread Tziporet Koren
Pawel Dziekonski wrote: On Mon, 16 Nov 2009 at 05:39:45PM +0100, Pawel Dziekonski wrote: Hello, where do I find SRP user manual? There is no manual in OFED distro, I have also checked main website and wiki. Manual is mentioned in OFED/docs/SRPT_README.txt. Hello again. I got no answe

Re: RDMAoE verbs questions

2009-11-25 Thread Tziporet Koren
Jason Gunthorpe wrote: On Tue, Nov 24, 2009 at 06:23:15PM -0500, Jeff Squyres wrote: 2. I am somewhat confused by the overloading of the term "transport". It appears that a device will have ibv_device.transport_type==IBV_TRANSPORT_IB for both IB and RDMAOE devices. The only way to tel

Re: QoS settings not mapped correctly per pkey ?

2009-11-25 Thread Vincent Ficet
Yevgeny, > Hi Vincent, > > Vincent Ficet wrote: >> Hello, >> >> Following the QoS experiments I carried out yesterday, I wanted to set >> up 3 IP networks, each one bound to a particular pkey, in order to >> achieve QoS for each network. >> Unfortunately, it seems that something is not mapped prop

[ANNOUNCE] OFED 1.5 rc3 release is available

2009-11-25 Thread Vladimir Sokolovsky
OFED 1.5-rc3 is available Notes: The tarball is available on: http://www.openfabrics.org/builds/ofed-1.5/release/OFED-1.5-rc3.tgz To get BUILD_ID run ofed_info Please report any issues in bugzilla https://bugs.openfabrics.org/ for OFED 1.5 Vladimir & Tziporet ===

Re: QoS settings not mapped correctly per pkey ?

2009-11-25 Thread Yevgeny Kliteynik
Hi Vincent, Vincent Ficet wrote: Hello, Following the QoS experiments I carried out yesterday, I wanted to set up 3 IP networks, each one bound to a particular pkey, in order to achieve QoS for each network. Unfortunately, it seems that something is not mapped properly in the ULP layers (vlarb

Re: RDMAoE verbs questions

2009-11-25 Thread Jeff Squyres
On Nov 24, 2009, at 11:52 PM, Jason Gunthorpe wrote: > OMPI uses RDMACM (among others), so I'm not sure I follow what you're > asking me...? I think I'm asking you about the non RDMACM stuff in openmpi, ibcm, xoob, etc. I can't tell at glance if any of them will be safe to run on RDMAoE as-is

Re: RDMAoE verbs questions

2009-11-25 Thread Jeff Squyres
On Nov 25, 2009, at 2:25 AM, Or Gerlitz wrote: > I was reviewing Mellanox's Open MPI patches for RDMAoE support Can you send us point to the patch series (mail thread or some repository where they sit)? Here's one thread: http://www.open-mpi.org/community/lists/devel/2009/11/7063.php the l

QoS settings not mapped correctly per pkey ?

2009-11-25 Thread Vincent Ficet
Hello, Following the QoS experiments I carried out yesterday, I wanted to set up 3 IP networks, each one bound to a particular pkey, in order to achieve QoS for each network. Unfortunately, it seems that something is not mapped properly in the ULP layers (vlarb tables are fine). The settings are

Re: OFED-1.x SRP's user manual

2009-11-25 Thread Pawel Dziekonski
On Mon, 16 Nov 2009 at 05:39:45PM +0100, Pawel Dziekonski wrote: > Hello, > > where do I find SRP user manual? There is no manual in OFED distro, > I have also checked main website and wiki. Manual is mentioned in > OFED/docs/SRPT_README.txt. Hello again. I got no answers - does the manual exist

Re: Re: RDMAoE verbs questions

2009-11-25 Thread Pavel Shamis (Pasha)
I think I'm asking you about the non RDMACM stuff in openmpi, ibcm, xoob, etc. I can't tell at glance if any of them will be safe to run on RDMAoE as-is.. The oob and xoob are custom ompi mpi connection manager that were created specially for Infiniband ONLY. So as result they do what they

[ANNOUNCE] uDAPL library: v1 - compat-1.2.15 and v2 - dapl-2.0.25 release

2009-11-25 Thread Davis, Arlin R
New release for uDAPL 1.2 and 2.0 available on the OFA download page and in my git tree. md5sum: d7b710aebd8bb9b48b6b8982f71f62c7 compat-dapl-1.2.15.tar.gz md5sum: 3a14b650bbfbe38243eb4a11157bef5d dapl-2.0.25.tar.gz Summary of v1 and v2 changes since last release: v1 - Release 1.2.15 fixes: