Re: [gpfsug-discuss] EDR and omnipath

2016-09-19 Thread Aaron Knister
might work, but that will be hard to find somebody to support. Sent from IBM Verse Aaron Knister --- Re: [gpfsug-discuss] EDR and omnipath --- From:"Aaron Knister" To:gpfsug-discuss@spectrumscale.org Date:Mon, Sep 19, 2016 1:35 PM Subject: Re: [gpfsug-discu

Re: [gpfsug-discuss] EDR and omnipath

2016-09-19 Thread Aaron Knister
Aaron Knister --- Re: [gpfsug-discuss] EDR and omnipath --- From: "Aaron Knister" To: gpfsug-discuss@spectrumscale.org Date: Mon, Sep 19, 2016 1:35 PM Subject: Re: [gpfsug-discuss] EDR and omnipath I

Re: [gpfsug-discuss] EDR and omnipath

2016-09-19 Thread Sven Oehme
Because they both require a different distribution of OFED, which are mutual exclusive to install. in theory if you deploy plain OFED it might work, but that will be hard to find somebody to support. Sent from IBM Verse Aaron Knister --- Re: [gpfsug-discuss] EDR and omnipath --- From

Re: [gpfsug-discuss] EDR and omnipath

2016-09-19 Thread Aaron Knister
I must admit, I'm curious as to why one cannot use GPFS with IB and OPA both in RDMA mode. Granted, I know very little about OPA but if it just presents as another verbs device I wonder why it wouldn't "Just work" as long as GPFS is configured correctly. -Aaron On 9/19/16 3:11 AM, Vic Cornell

Re: [gpfsug-discuss] EDR and omnipath

2016-09-19 Thread Vic Cornell
Bump I can see no reason why that wouldn't work. But it would be nice to a have an official answer or evidence that it works. Vic > On 15 Sep 2016, at 5:49 pm, Brian Marshall wrote: > > All, > > I see in the GPFS FAQ A6.3 the statement below. Is it possible to have GPFS > do RDMA over EDR

[gpfsug-discuss] EDR and omnipath

2016-09-16 Thread Brian Marshall
All, I see in the GPFS FAQ A6.3 the statement below. Is it possible to have GPFS do RDMA over EDR infiniband and non-RDMA communication over omnipath (IP over fabric) when each NSD server has an EDR card and a OPA card installed? RDMA is not supported on a node when both Mellanox HCAs and Inte