Re: Virtual ibnetdiscover command fails

On 06/02/2013 11:17, Mathis GAVILLON wrote: Ok. But what is it possible to do with Infiniband VFs if QP0 is not available ? EVERYTHING, e.g run IPoIB, iSER, RDS, MPI, etc, etc - except for what requires QP0, such as running SM or issuing SMPs for discovery/diagnostics purposes 2013/2/5

Re: Virtual ibnetdiscover command fails

EVERYTHING, e.g run IPoIB, iSER, RDS, MPI, etc, etc - except for what requires QP0, such as running SM or issuing SMPs for discovery/diagnostics purposes Ok. I just begin with Infiniband technologie so I don't know everything about this yet. Thanks Mathis -- To unsubscribe from this list:

[ANNOUNCE] OpenSM tarball release

Hi, There is a new release of OpenSM. Tarball available in: http://www.openfabrics.org/downloads/management/ (listed in http://www.openfabrics.org/downloads/management/latest.txt) md5sum: 32b16efbaba69d478f8c05df42ce0462 opensm-3.3.16.tar.gz All component versions are from recent master

Re: Virtual ibnetdiscover command fails

On 06/02/2013 12:04, Mathis GAVILLON wrote: Just a last question : is that possible VFs lid to be different from PF one ? NO, we've implemented a shared port model, so all functions on the same IB port use the same lid, each function has its own virtual GUID though. Or. Thanks 2013/2/6

Re: Virtual ibnetdiscover command fails

On 06.02.2013 10:22, Or Gerlitz wrote: On 06/02/2013 11:17, Mathis GAVILLON wrote: Ok. But what is it possible to do with Infiniband VFs if QP0 is not available ? EVERYTHING, e.g run IPoIB, iSER, RDS, MPI, etc, etc - except for what requires QP0, such as running SM or issuing SMPs for

Re: Virtual ibnetdiscover command fails

On 06.02.2013 11:20, Or Gerlitz wrote: On 06/02/2013 12:04, Mathis GAVILLON wrote: Just a last question : is that possible VFs lid to be different from PF one ? NO, we've implemented a shared port model, so all functions on the same IB port use the same lid, each function has its own

Re: Virtual ibnetdiscover command fails

On 06/02/2013 12:40, Sebastian Riemer wrote: So if I don't use the unmaintained srptools to get the SRP connection strings but instead send them directly to the initiator to connect to the SRP target, then also SRP should be possible with the virtual GUID. Am I right? Basically YES, you can

NFS over RDMA crashing

Hi. I have been trying to create a setup with NFS/RDMA, but I am getting crashes. I am using Mellanox ConnectX 3 HCA with SRIOV enabled with two KVM VMs with RHEL 6.3 getting one VF each. My test case is trying to use one VM's storage from another using NFS over RDMA (192.168.20.210 server,

Re: NFS over RDMA crashing

On 2/6/2013 9:48 AM, Yan Burman wrote: When I moved to commit 79f77bf9a4e3dd5ead006b8f17e7c4ff07d8374e I was no longer getting the server crashes, so the reset of my tests were done using that point (it is somewhere in the middle of 3.7.0-rc2). +tom tucker I'd try going back a few kernels,

[PATCH for-next 01/10] IB/mlx4_ib: Remove local invalidate segment unused fields

From: Shani Michaeli sha...@mellanox.com Remove unused fields from the local invalidate WQE segment structure. Signed-off-by: Haggai Eran hagg...@mellanox.com Signed-off-by: Shani Michaeli sha...@mellanox.com Signed-off-by: Or Gerlitz ogerl...@mellanox.com --- drivers/infiniband/hw/mlx4/qp.c |

[PATCH for-next 00/10] mlx4: Add Memory Windows support

Hi Roland, Here's a series from Shani Michaeli and Haggai Eran adds mlx4 driver support for Memory Windows. The first entries in this set are pre patches preparing the grounds for the actual implementation of MWs. Later there're two core patches, one to ib_verbs.h adding support for type 2

[PATCH for-next 03/10] net/mlx4_core: Propogate MR deregistration failure

From: Shani Michaeli sha...@mellanox.com MR deregistration fails when memory windows are bound to it. Handle such failures by propagating it to the caller ULP. Signed-off-by: Haggai Eran hagg...@mellanox.com Signed-off-by: Shani Michaeli sha...@mellanox.com Signed-off-by: Or Gerlitz

[PATCH for-next 04/10] net/mlx4_core: Disable memory windows for VFs

From: Shani Michaeli sha...@mellanox.com Do not enable memory windows allocation for virtual functions. In addition, add a few safety checks, such as: * Verifying the PD of a new MPT matches the VF. * Making sure binding memory window isn't enabled for FMRs, and that new memory windows are

[PATCH for-next 07/10] IB/uverbs: Implement memory windows support in uverbs

From: Shani Michaeli sha...@mellanox.com The existing user/kernel uverbs API has IB_USER_VERBS_CMD_ALLOC/DEALLOC_MW, implement these calls, along with destroying user memory windows during process cleanup. Signed-off-by: Haggai Eran hagg...@mellanox.com Signed-off-by: Shani Michaeli

[PATCH for-next 09/10] IB/mlx4_ib: Support memory window binding

From: Shani Michaeli sha...@mellanox.com * Implement memory windows binding in mlx4_ib_post_send. * Implement mlx4_ib_bind_mw by deferring to mlx4_ib_post_send. * Rename MLX4_WQE_FMR_PERM_* flags to MLX4_WQE_FMR_AND_BIND_PERM_*, indicating that they are used both for fast registration work

[PATCH for-next 10/10] IB/mlx4_ib: Advertize MW support

From: Shani Michaeli sha...@mellanox.com Indicate memory windows support through device capabilities, kernel verb entries and the relevant uverbs command mask entries. Signed-off-by: Haggai Eran hagg...@mellanox.com Signed-off-by: Shani Michaeli sha...@mellanox.com Signed-off-by: Or Gerlitz

[PATCH for-next 02/10] net/mlx4_core: Rename MPT related service routines to have mpt_ prefix

From: Shani Michaeli sha...@mellanox.com The MPT - Memory Protection Table - is used by both memory windows and memory regions. Hence, all MPT references are relevant for both types of memory objects. Rename the relevant functions to start with mpt_ instead of the current mr_ prefix.

[PATCH for-next 06/10] IB/core: Enhance memory windows support

From: Shani Michaeli sha...@mellanox.com This patch enhanced the IB core support for Memory Windows. Memory Windows (MW) allow an application to have better/flexible control over remote access to memory. Two types of MWs are supported: Type 1 - associated with PD only Type 2A - associated

Re: NFS over RDMA crashing

Hi. In case you're interested, I did the NFS/RDMA backports for OFED. I tested that NFS/RDMA in OFED 3.5 works on kernel 3.5, and also the RHEL 6.3 kernel. However, I did not test it with SRIOV. If you test it (OFED-3.5-rc6 was released last week), I'd like to know how it goes. Thanks. Jeff

[PATCH 42/77] IB/ehca: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo t...@kernel.org Cc: Hoang-Nam Nguyen hngu...@de.ibm.com Cc: Christoph Raisch rai...@de.ibm.com Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/ehca/ehca_cq.c | 27 +++

[PATCH 41/77] IB/cxgb4: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo t...@kernel.org Reviewed-by: Steve Wise sw...@opengridcomputing.com Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/cxgb4/iw_cxgb4.h | 27 ++- 1 file changed, 14

[PATCH 45/77] IB/ocrdma: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo t...@kernel.org Cc: Roland Dreier rol...@purestorage.com Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/ocrdma/ocrdma_main.c | 14 +- 1 file changed, 1 insertion(+), 13 deletions(-)

[PATCH 46/77] IB/qib: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo t...@kernel.org Cc: Mike Marciniszyn infinip...@intel.com Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/qib/qib_init.c | 21 - 1 file changed, 8 insertions(+), 13

[PATCH 44/77] IB/mlx4: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo t...@kernel.org Cc: Jack Morgenstein ja...@dev.mellanox.co.il Cc: Or Gerlitz ogerl...@mellanox.com Cc: Roland Dreier rol...@purestorage.com Cc: linux-rdma@vger.kernel.org ---

[PATCH 43/77] IB/ipath: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo t...@kernel.org Cc: Mike Marciniszyn infinip...@intel.com Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/ipath/ipath_driver.c | 16 1 file changed, 4 insertions(+), 12

[PATCH 40/77] IB/cxgb3: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo t...@kernel.org Reviewed-by: Steve Wise sw...@opengridcomputing.com Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/cxgb3/iwch.h | 24 +++- 1 file changed, 11 insertions(+),

[PATCH 38/77] IB/core: convert to idr_alloc()

Convert to the much saner new idr interface. Only compile tested. v2: Mike triggered WARN_ON() in idr_preload() because send_mad(), which may be used from non-process context, was calling idr_preload() unconditionally. Preload iff @gfp_mask has __GFP_WAIT. Signed-off-by: Tejun Heo

Re: [PATCH for 3.8 v3, resend 0/3] IB/SRP patches for kernel 3.8

Bart Van Assche wrote: On 02/05/13 21:54, Or Gerlitz wrote: On Tue, Feb 5, 2013 at 6:25 PM, Bart Van Assche bvanass...@acm.org wrote: On 02/04/13 22:11, Or Gerlitz wrote: Bart, I'd like to sharpen the point: could you please clarify if the series posted to linux-rdma stands for itself in the

Re: NFS over RDMA crashing

On Wed, Feb 06, 2013 at 05:48:15PM +0200, Yan Burman wrote: When killing mount command that got stuck: --- BUG: unable to handle kernel paging request at 880324dc7ff8 IP: [a05f3dfb] rdma_read_xdr+0x8bb/0xd40 [svcrdma] PGD 1a0c063 PUD

Re: NFS over RDMA crashing

On 2/6/2013 4:24 PM, J. Bruce Fields wrote: On Wed, Feb 06, 2013 at 05:48:15PM +0200, Yan Burman wrote: When killing mount command that got stuck: --- BUG: unable to handle kernel paging request at 880324dc7ff8 IP: [a05f3dfb]

[PATCH V3 1/3] infiniband-diags: libibnetdisc add find node by lid

NOTE: this change adds a glib requirement to the package. Changes since V1: Use GINT_TO_POINTER rather than allocating keys Changes since V2: Use internal object everywhere rather than just hacked into discover_fabric Generate lid2port hash when reading cached

[PATCH V3 2/3] infiniband-diags: add dump_fts tool

dump_fts adds a faster version of the functionality of dump_[l|m]fts.sh. This code is based off of the ibroute code and simply uses libibnetdisc to scan the fabric instead of using ibnetdiscover and letting ibroute requery all that data over again. This improves things in 3 ways. 1)

[GIT PULL] please pull infiniband.git

Hi Linus, Please pull from git://git.kernel.org/pub/scm/linux/kernel/git/roland/infiniband.git tags/rdma-for-linus IB regression fixes for 3.8: - Fix mlx4 VFs not working on old guests because of 64B CQE changes - Fix

OFA Management maintainership

Hi, I want to announce that starting from today Hal Rosenstock which you are familiar with, is going to maintain OpenSM, libibumad and ibsim development. So starting from today his trees should be considered as master development trees: git://git.openfabrics.org/~halr/libibumad

RE: OFA Management maintainership

Hi, I think we all owe a debt of gratitude for Alex's excellent 2+ years of OpenSM, libibumad, and ibsim maintainership. I hope I can live up to the high standard Alex set. Thanks for all you've done Alex! -- Hal -Original Message- From: Alex Netes [mailto:ale...@dev.mellanox.co.il]