Re: [ewg] Mellanox target workaround in SRP

2011-01-18 Thread Vu Pham
David Dillow wrote: > On Mon, 2011-01-10 at 11:58 -0800, Vu Pham wrote: >> David Dillow wrote: >> > either. The SRP FMR mapping code is careful to mask the SG address with >> > the FMR page mask, so we should never ask the HCA to map a page with the >> > firs

Re: [ewg] Mellanox target workaround in SRP

2011-01-10 Thread Vu Pham
David Dillow wrote: > On Mon, 2011-01-10 at 10:21 -0800, Vu Pham wrote: >> David Dillow wrote: >>> On Fri, 2011-01-07 at 20:05 -0800, Roland Dreier wrote: >>>> looking at the patch, I would guess that the corruption occurred when >>>> the target go

Re: [ewg] Mellanox target workaround in SRP

2011-01-10 Thread Vu Pham
Roland Dreier wrote: > > I think that the patch is specific for srp initiator using Mellanox > > FMR. It tried to avoid indirect desc with Mellanox FMR having > > first-byte-offset != 0. Since the low level implementation of > > mlx4/mthca_map_phys_fmr() did not create + setup MPT for FMR wi

Re: [ewg] Mellanox target workaround in SRP

2011-01-10 Thread Vu Pham
David Dillow wrote: > On Fri, 2011-01-07 at 20:05 -0800, Roland Dreier wrote: >> > I'm sure this was tested and shown to fix the problem; I'm just confused >> > as to what the problem really was and if this is still relevant. Can >> > someone please enlighten me? >> >> At this point I'm afraid

Re: [ewg] [PATCH v1 09/10] mlx4_fc: Implement fcoe/fcoib offload driver, fcoib initialization protocol driver

2010-08-18 Thread Vu Pham
> > > > I skimmed through the patch and just noticed a few issues. I didn't > do anything like a full review. I'm copying de...@open-fcoe.org, although > some of them have seen this on the linux-scsi list. > Thanks for your review and comments. >> +static int mlx4_fip_recv(struct sk_buff

Re: [ewg] [PATCH v1 10/10] mlx4_fc: Enable FC over Ethernet/Infiniband drivers

2010-08-18 Thread Vu Pham
ts to discover BridgeX gateways in the > Infiniband fabric. > ? > > end sentence with ".". Thanks for you comments. >From 54041f56fa1896388a52f503e43e21aa11cc9a2a Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Tue, 17 Aug 2010 15:40:42 -0700 Subject: [PATCH 10/10

[ewg] [PATCH v1 10/10] mlx4_fc: Enable FC over Ethernet/Infiniband drivers

2010-08-16 Thread Vu Pham
>From 17b0c5412e085e1f288c05cb667ec36e4a05c59b Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Mon, 16 Aug 2010 14:48:01 -0700 Subject: [PATCH 10/10] mlx4_fc: Enable FC over Ethernet/Infiniband drivers Add entries in scsi's Kconfig and Makefile to enable mlx4_fc (fcoe/fcoib offload dri

[ewg] [PATCH v1 08/10] mlx4: Add API to query protocol device of specific port on mlx4_device

2010-08-16 Thread Vu Pham
>From f29fe7ee6b8563eb362e22b8276e817e0337f048 Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Mon, 16 Aug 2010 10:16:42 -0700 Subject: [PATCH 08/10] mlx4: Add API to query protocol device of specific port on mlx4_device Adding new fields in mlx4_interface to set the type of protocol (IB,

[ewg] [PATCH v1 07/10] mlx4_core: Enable T11 support bit in mlx4 device

2010-08-16 Thread Vu Pham
>From 85efcd1d8e1fae3bd5293d923eaf1aa50d54cbce Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Fri, 13 Aug 2010 10:01:31 -0700 Subject: [PATCH 07/10] mlx4_core: Enable T11 support bit in mlx4 device Enable T11 support bit in mlx4 device Add bool parameter to enable/disable pre_t11 support

[ewg] [PATCH v1 06/10] mlx4: Enable create and attach cq to the vector with least number of cqs already attached

2010-08-16 Thread Vu Pham
>From 2d10665af8bfa41f772bedc18592b76b96c06729 Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Tue, 10 Aug 2010 14:33:51 -0700 Subject: [PATCH 06/10] mlx4: Enable create and attach cq to the vector with least number of cqs already attached When the vector number passed to mlx4_cq_alloc

[ewg] [PATCH v1 05/10] mlx4_core: Map phys_fmr with first byte offset enabled

2010-08-16 Thread Vu Pham
>From 1afc1f9cfe33444c26dc027556035c7c85a9a565 Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Tue, 10 Aug 2010 14:27:23 -0700 Subject: [PATCH 05/10] mlx4_core: Map phys_fmr with first byte offset enabled map_phys_fmr_fbo() is very much like the original map_phys_fmr(): . allows setting

[ewg] [PATCH v1 04/10] mlx4_core: Add interface to allocate fmr with pre-reserved MPTs

2010-08-16 Thread Vu Pham
>From 9652f29170c7daabf2e9a62acb848a05dc71db9a Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Tue, 10 Aug 2010 14:16:50 -0700 Subject: [PATCH 04/10] mlx4_core: Add interface to allocate fmr with pre-reserved MPTs As we did with MRs, the fmr_alloc() will call mr_alloc() to allocate bitmap

[ewg] [PATCH v1 03/10] mlx4_core: Add mr_reserve_range to pre-reserve a range of MPTs

2010-08-16 Thread Vu Pham
>From b570c5df5006119ac626d96551cc0a9935037e5f Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Tue, 10 Aug 2010 14:10:57 -0700 Subject: [PATCH 03/10] mlx4_core: Add mr_reserve_range to pre-reserve a range of MPTs Add MPTs mr_reserve/free_range Remove QPs and MPTs static reservation for FC_E

[ewg] [PATCH v1 02/10] mlx4_core: Add mr_alloc_reserved to able create MPTs with pre-reserve range

2010-08-16 Thread Vu Pham
>From 7c943349148dcbcb173814a9b6800ac2a2b12626 Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Tue, 10 Aug 2010 14:03:53 -0700 Subject: [PATCH 02/10] mlx4_core: Add mr_alloc_reserved to able create MPTs with pre-reserve range As we did with QPs, range of the MPTs are pre-reserved (the MPTs t

[ewg] [PATCH v1 0/10] Add fcoe, fcoib drivers for mlx4 device

2010-08-16 Thread Vu Pham
Hi Roland, Thanks for your feedbacks for previous patch set. I reworked, rearranged order of the patches as suggested. Please ignore the previous patch set. Here is the new one. The following series implements fcoe and fcoib offload driver for mlx4 device mlx4_fc: implement fcoe/fcoib, hook to

[ewg] [PATCH v1 01/10] mlx4_core: Change fw profile and qp context to enable FC

2010-08-16 Thread Vu Pham
>From 5fd7e9795e085ff64b2396a5339f98e9b7021965 Mon Sep 17 00:00:00 2001 From: Vu Pham Date: Tue, 10 Aug 2010 13:55:43 -0700 Subject: [PATCH 01/10] mlx4_core: Change fw profile and qp context to enable FC Increase num_qp, num_mpt resource in fw profile to enable FC Add fields in qp context

[ewg] [PATCH 09/10] enable mlx4_fc, mlx4_fcoib in scsi Kconfig, makefile

2010-08-06 Thread Vu Pham
Enable mlx4_fc (fcoe/fcoib offload driver) and mlx4_fcoib (discovery driver) entries in scsi/Kconfig and Makefile Signed-off-by: Vu Pham Enable mlx4_fc (fcoe/fcoib offload driver) and mlx4_fcoib (discovery driver) entries in scsi/Kconfig and Makefile Signed-off-by: Vu Pham --- a/drivers

[ewg] [PATCH 07/10] query the steer capabilities of mlx4 device

2010-08-06 Thread Vu Pham
Add API to query the steer capabilities of mlx4 device Signed-off-by: Oren Duer Signed-off-by: Vu Pham Add API to query the steer capabilities of mlx4 device Signed-off-by: Oren Duer Signed-off-by: Vu Pham diff --git a/include/linux/mlx4/device.h b/include/linux/mlx4/device.h index

[ewg] [PATCH 06/10] enable T11 bit for mlx4 device

2010-08-06 Thread Vu Pham
Enable T11 bit support on mlx4 device Signed-off-by: Oren Duer Signed-off-by: Vu Pham drivers/net/mlx4/fw.c | 13 + include/linux/mlx4/device.h |5 - 2 files changed, 17 insertions(+), 1 deletions(-) Enable T11 bit in mlx4 device Signed-off-by: Oren Duer Signed

[ewg] [PATCH 08/10] enable vlan support in mlx4 qp path

2010-08-06 Thread Vu Pham
Enable vlan support in qp path, allow traffic to be encapsulated in tagged vlan frames. Signed-off-by: Vu Pham Enable vlan support in qp path, allow traffic to be encapsulated in tagged vlan frames. Signed-off-by: Vu Pham diff --git a/include/linux/mlx4/qp.h b

[ewg] [PATCH 05/10] query ib device from given mlx4 device

2010-08-06 Thread Vu Pham
Adding API to query ib_device with mlx4_dev Signed-off-by: Oren Duer Signed-off-by: Vu Pham drivers/infiniband/hw/mlx4/main.c | 10 +- drivers/net/mlx4/intf.c | 20 drivers/net/mlx4/main.c | 10 +++--- drivers/net/mlx4/mlx4.h

[ewg] [PATCH 04/10] remove default reservation of fexch qps and mpts

2010-08-06 Thread Vu Pham
mlx4_core: removed reservation of FEXCH QPs and MPTs mlx4_fc module will reserve them upon loading. Added mpt reserve_range and release_range functions. Signed-off-by: Oren Duer Signed-off-by: Vu Pham drivers/net/mlx4/main.c |4 +--- drivers/net/mlx4/mr.c | 29

[ewg] [PATCH 03/10] attach cq to least cqs attached completion vector

2010-08-06 Thread Vu Pham
is cq vector number, it uses MLX4_LEAST_ATTACHED_VECTOR Signed-off-by: Yevgeny Petrilin Signed-off-by: Vu Pham drivers/infiniband/hw/mlx4/cq.c |4 +++- drivers/net/mlx4/cq.c | 27 +++ drivers/net/mlx4/en_cq.c|2 +- drivers/net/mlx4/mlx4.h |

[ewg] [PATCH 02/10] api to query mlx4_en device for given mlx4 device

2010-08-06 Thread Vu Pham
mlx4_en: Add API to query interfaces for given internal device Updated mlx4_en interface to provide a query function for it's internal net_device structure. Signed-off-by: Oren Duer Signed-off-by: Vu Pham drivers/net/mlx4/en_main.c | 14 ++ drivers/net/mlx4/i

[ewg] [PATCH 01/10] pre-reserve MPTs for FC

2010-08-06 Thread Vu Pham
e the original map_phys_fmr() allows setting an FBO (First Byte Offset) for the MPT allows setting the data length for the MPT does not increase the higher bits of the key after every map. Signed-off-by: Yevgeny Petrilin Signed-off-by: Oren Duer Signed-off-by: Vu Pham drivers/net/mlx4/main.c |

[ewg] [PATCH 00/10] Add fcoe, fcoib drivers for mlx4 device

2010-08-06 Thread Vu Pham
ernal device Add MPT reserve/release_range APIs Vu Pham: Enable vlan support in qp path Enable mlx4_fc/mlx4_fcoib driver in scsi Kconfig/Makefile Add mlx4_fc/mlx4_fcoib drivers drivers/infiniband/hw/mlx4/cq.c |4 +- drivers/infiniband/hw/mlx4/main.c | 10 +- drivers/net

Re: [ewg] nfsrdma fails to write big file,

2010-03-01 Thread Vu Pham
> -Original Message- > From: Tom Tucker [mailto:t...@opengridcomputing.com] > Sent: Saturday, February 27, 2010 8:23 PM > To: Vu Pham > Cc: Roland Dreier; linux-r...@vger.kernel.org; Mahesh Siddheshwar; > ewg@lists.openfabrics.org > Subject: Re: [ewg] nfsrdma fa

Re: [ewg] nfsrdma fails to write big file,

2010-02-24 Thread Vu Pham
CRDMA_MEMWINDOWS_ASYNC: case RPCRDMA_MEMWINDOWS: > -Original Message- > From: ewg-boun...@lists.openfabrics.org [mailto:ewg- > boun...@lists.openfabrics.org] On Behalf Of Vu Pham > Sent: Monday, February 22, 2010 12:23 PM > To: Tom Tucker > Cc: linux-r...@vger.

Re: [ewg] nfsrdma fails to write big file,

2010-02-22 Thread Vu Pham
llanox-2 kernel: RPC: rpcrdma_event_process: send WC status 5, vend_err F5 Feb 22 12:17:00 mellanox-2 kernel: rpcrdma: connection to 13.20.1.9:20049 closed (-103) -vu > -Original Message- > From: Tom Tucker [mailto:t...@opengridcomputing.com] > Sent: Monday, February 22, 2010 10:49 A

[ewg] nfsrdma fails to write big file,

2010-02-22 Thread Vu Pham
Setup: 1. linux nfsrdma client/server with OFED-1.5.1-20100217-0600, ConnectX2 QDR HCAs fw 2.7.8-6, RHEL 5.2. 2. Solaris nfsrdma server svn 130, ConnectX QDR HCA. Running vdbench on 10g file or *dd if=/dev/zero of=10g_file bs=1M count=1*, operation fail, connection get drop, client cannot re

Re: [ewg] MLX4 Strangeness

2010-02-18 Thread Vu Pham
Hi Tom, Status 12 = IB_WC_RETRY_EXC_ERR Vendor_err = 129 --> Timeout and transport error counter exceeded This indicates that we lost connection to the client ie. something went wrong on client side (bad operation cause QP error...) please try to catch any error on the client (qp async event, cq

Re: [ewg] [GIT PULL ofed-1.4.1] xprtrdma: The frmr iova_start values are truncated by the nfs rdma client.

2009-04-24 Thread Vu Pham
Steve, You should have the same fix for the server side as well Here is the patch -vu A bad cast causes the iova_start, which in this case is a DMA bus address, to be truncated on 32b systems. No cast is needed. Signed-off-by: Steve Wise --- net/sunrpc/xprtrdma/verbs.c |2 +- 1 fil

Re: [ewg] [PATCH] rnfs-utils not being installed on RHEL5.3

2009-03-20 Thread Vu Pham
Jon/Vlad, Here is the patch for install.pl to remove the check for building/installing nfsrdma module on system(s) which has or has not had nfs-utils > 1.1.1 User need to choose rnfs-utils=y to have mount.rnfs thanks, -vu Hey Vlad, I tried to install OFED-1.4.1-rc2 on the RHEL5.3 system, an

Re: [ewg] Re: cannot install SCST with SRP support

2008-03-09 Thread Vu Pham
Hi Erez, SCST revision 245 does not work with 2.6.24 (it only supports up to 2.6.23). You need latest revision; however, you may have problem to compile srpt with latest scst revision -vu Vu, We were able to build and run SCST on SLES 10. Now, when I try to build it for 2.6.24, I get erro

Re: [ewg] Re: cannot install SCST with SRP support

2008-03-09 Thread Vu Pham
Doron Shoham wrote: Vu Pham wrote: In order to run with *scst_disk* you need to patch and rebuild the kernel. Please follow SCST readme to do this task If you don't want to patch and rebuild the kernel, you can run with *scst_vdisk* and get the same performance. I attach here an examp

Re: [ewg] Re: cannot install SCST with SRP support

2008-03-04 Thread Vu Pham
I got: a. modprobe scst b. modprobe scst_disk In order to run with *scst_disk* you need to patch and rebuild the kernel. Please follow SCST readme to do this task If you don't want to patch and rebuild the kernel, you can run with *scst_vdisk* and get the same performance. I attach here

[ewg] Re: cannot install SCST with SRP support

2008-03-03 Thread Vu Pham
Doron Shoham wrote: Hi, I'm trying to install SCST with SRP support. I have followed the instructions on the SRPT_README.txt file: So far I have done the following steps: 1. a. git clone git://git.openfabrics.org/~vu/srpt_inc ~/srpt_inc b. Checking out scst's svn development t

Re: [ewg][PATCH][0/2] SRP multipath failover within 60 seconds,

2008-02-07 Thread Vu Pham
David Dillow wrote: On Thu, 2008-02-07 at 08:18 +0200, Vladimir Sokolovsky wrote: Vu Pham wrote: The following patches assist SRP/dm-multipath to failover within 60 seconds (bugzilla #577) without data corruption, read/write error [snip] Applied, kernel_patches/fixes

Re: [ewg][PATCH][1/2] SRP multipath failover within 60 seconds,

2008-02-06 Thread Vu Pham
Roland Dreier wrote: > diff --git a/drivers/infiniband/ulp/srp/ib_srp.c b/drivers/infiniband/ulp/srp/ib_srp.c > index 950228f..45a2533 100644 > --- a/drivers/infiniband/ulp/srp/ib_srp.c > +++ b/drivers/infiniband/ulp/srp/ib_srp.c > @@ -400,7 +400,6 @@ > printk(KERN_DEBUG PFX "Sen

Re: [ewg][PATCH][1/2] SRP multipath failover within 60 seconds,

2008-02-06 Thread Vu Pham
Vu Pham wrote: Roland Dreier wrote: > diff --git a/drivers/infiniband/ulp/srp/ib_srp.c b/drivers/infiniband/ulp/srp/ib_srp.c > index 950228f..45a2533 100644 > --- a/drivers/infiniband/ulp/srp/ib_srp.c > +++ b/drivers/infiniband/ulp/srp/ib_srp.c > @@ -400,7 +400,6 @@ &g

Re: [ewg][PATCH][1/2] SRP multipath failover within 60 seconds,

2008-02-06 Thread Vu Pham
Roland Dreier wrote: > diff --git a/drivers/infiniband/ulp/srp/ib_srp.c b/drivers/infiniband/ulp/srp/ib_srp.c > index 950228f..45a2533 100644 > --- a/drivers/infiniband/ulp/srp/ib_srp.c > +++ b/drivers/infiniband/ulp/srp/ib_srp.c > @@ -400,7 +400,6 @@ > printk(KERN_DEBUG PFX "Sen

Re: [ewg][PATCH][0/2] SRP multipath failover within 60 seconds,

2008-02-06 Thread Vu Pham
EXTRA NOTES: 1. pull cable/ plug back in (or ibportstate disable/enable) a. Within 30 seconds I/Os resume on the same path (with same cm_id, qp and cq) b. Within 30-45 seconds, I/Os resume on the same path (with new cm_id, qp and cq) c. >45 seconds, I/Os fail-over to next path 2. After runnin

[ewg][PATCH][2/2] SRP multipath failover within 60 seconds,

2008-02-06 Thread Vu Pham
srp_qp_in_err_timer_reconnect_target.patch - when detecting a post_send/post_receive error, srp set qp_in_error, set a timer to reconnect to target, return SCSI_MLQUEUE_HOST_BUSY to lock the queue, and return DID_NO_CONNECT when target state is DEAD or REMOVED Signed-off-by: Vu Pham <[EM

[ewg][PATCH][1/2] SRP multipath failover within 60 seconds,

2008-02-06 Thread Vu Pham
at reconnect) Signed-off-by: Vu Pham <[EMAIL PROTECTED]> diff --git a/drivers/infiniband/ulp/srp/ib_srp.c b/drivers/infiniband/ulp/srp/ib_srp.c index 950228f..45a2533 100644 --- a/drivers/infiniband/ulp/srp/ib_srp.c +++ b/drivers/infiniband/ulp/srp/ib_srp.c @@ -400,7 +400,6 @@ printk(KERN

[ewg][PATCH][0/2] SRP multipath failover within 60 seconds,

2008-02-06 Thread Vu Pham
The following patches assist SRP/dm-multipath to failover within 60 seconds (bugzilla #577) without data corruption, read/write error 1. srp_disconnect_without_wait.patch - srp send disconnect request without waiting for CM timewait exit event since srp current does not re-use the cm_id and q

[ewg][GIT PULL] please pull srpt ofed_1_3.git,

2008-02-03 Thread Vu Pham
Signed-off-by: Vu Pham <[EMAIL PROTECTED]> thanks, -vu ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] Re: [Scst-devel] [ofa-general] OFED 1.3 RC2 release is available

2008-01-29 Thread Vu Pham
Bart Van Assche wrote: On Jan 28, 2008 12:47 PM, Vladislav Bolkhovitin <[EMAIL PROTECTED]> wrote: Bart Van Assche wrote: Apparently OFED 1.3 includes SRP target support ? Although I consider SRP target support as a very valuable contribution, it should not be included in the OFED distribution b

[ewg] Re: Distributing the SRP target source code

2008-01-29 Thread Vu Pham
Bart Van Assche wrote: On Jan 29, 2008 9:20 AM, Vu Pham <[EMAIL PROTECTED]> wrote: There are two include paths. The first one is /usr/local/include/scst and the second one are drivers/infiniband/ulp/srpt. Therefore, building srpt in ofed will always use the /usr/local/include/scst path

[ewg] Re: Distributing the SRP target source code

2008-01-29 Thread Vu Pham
Bart Van Assche wrote: On Jan 28, 2008 6:07 PM, Vu Pham <[EMAIL PROTECTED]> wrote: On srpt readme file, the prerequisite is install SCST BEFORE ofed-1.3 or like Vlad warning "recompiling ofed" if you install scst after install ofed. This is what will happen if someone insta

[ewg][GIT PULL] please pull srpt ofed_1_3.git,

2008-01-25 Thread Vu Pham
Relying on scatterlist.h in backport header to support older kernels Signed-off-by: Vu Pham <[EMAIL PROTECTED]> srpt: Fix data corruption of using local mempool without lock Change the local buffer allocator to use a spin-lock protected linked list instead of an array of atomic_t used/free var

[ewg] Re: [ofa-general] OFED 1.x (Gen 2) based SRP target code released!

2007-06-13 Thread Vu Pham
Erez Zilber wrote: I'm trying to build srpt according to the instructions, but it does not get built at all. Here's what I did: tar xzf OFED-1.2-rc3.tgz cd OFED-1.2-rc3/SRPMS rpm2cpio ofa_kernel-1.2-rc3.src.rpm |cpio -i tar xzf ofa_kernel-1.2.tgz cd ofa_kernel-1.2 patch -p1 < ~/srpt_inc/add

[ewg] Re: [ofa-general] OFED 1.x (Gen 2) based SRP target code released!

2007-06-11 Thread Vu Pham
Erez Zilber wrote: Sujal Das wrote: Hello all, Mellanox is pleased to release the OFED 1.x (Gen 2) - based SRP Target source code to the OpenFabrics community, OEMs and end users. This release is an upgrade to the previously released SRP Target source code that was based on the Me