RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
, 2009 5:53 PM To: Sean Hefty Cc: 'Robert Pearson'; 'Jason Gunthorpe'; 'frank zago'; linux-rdma@vger.kernel.org; 'John Groves' Subject: Re: [Announce] rxe dev tree available (soft RDMAoE) Is there any commonality that can be shared between rxe and the qlogic driver? Interesting to note

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
Yes, but later. For now it is still being actively developed and is changing a lot. Once it settles down we plan to convert to patches and push up stream. I think you would probably be better off developing the kernel driver as a branch in an up-to-date kernel tree, and then worrying about

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
the warn and error messages. Bob -Original Message- From: Roland Dreier [mailto:rdre...@cisco.com] Sent: Thursday, December 17, 2009 3:26 PM To: Robert Pearson Cc: 'Jason Gunthorpe'; 'frank zago'; linux-rdma@vger.kernel.org; 'John Groves' Subject: Re: [Announce] rxe dev tree available (soft

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
We have thought that we could try CRC32C first and if that works then use that, otherwise fall back to CRC32 which would allow rxe to use CRC32C when talking to itself and get a speedup on new Intel CPUs. How would you negotiate that? Is this being worked in the definition of the IBoE

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Jason Gunthorpe
On Thu, Dec 17, 2009 at 03:43:56PM -0600, Robert Pearson wrote: I agree about the polynomial. That would have been nice. As currently proposed the embedding of the IB transport in Ethernet frames preserves the IB ICRC as part of the transport and trades the VCRC for Ethernet's CRC32 over the

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
then we would only use those kernels. -Original Message- From: Roland Dreier [mailto:rdre...@cisco.com] Sent: Thursday, December 17, 2009 3:26 PM To: Robert Pearson Cc: 'Jason Gunthorpe'; 'frank zago'; linux-rdma@vger.kernel.org; 'John Groves' Subject: Re: [Announce] rxe dev tree available

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Robert Pearson
To: 'Jason Gunthorpe' Cc: 'Roland Dreier'; 'frank zago'; 'linux-rdma@vger.kernel.org'; 'John Groves' Subject: RE: [Announce] rxe dev tree available (soft RDMAoE) Of course we need to interoperate with ConnectX-en and it, as far as I know, only knows how to compute the VCRC as though the packet

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Jason Gunthorpe
On Thu, Dec 17, 2009 at 05:00:26PM -0600, Robert Pearson wrote: Of course we need to interoperate with ConnectX-en and it, as far as I know, only knows how to compute the VCRC as though the packet was going to get sent to IB including a phantom 12 byte LRH that is filled with 1's without any

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
Of course we need to interoperate with ConnectX-en and it, as far as I know, only knows how to compute the VCRC as though the packet was going to get sent to IB including a phantom 12 byte LRH that is filled with 1's without any way to turn it off. It is also a requirement that UD work

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-17 Thread Roland Dreier
The ICRC isn't even necessary from a technical sense for DCE. The underlying reasons for the ICRC/VCRC split are not really present for ethernet. Considering RDMAoE isn't interoperable with existing IB anyhow and DCE can't do routing, the best course would be to just get rid of it

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Jason Gunthorpe
On Wed, Dec 16, 2009 at 03:06:37PM -0600, frank zago wrote: Hello, The development tree for a soft RDMA transport over Ethernet driver (rxe) is available in the OFA git repository. This is a work in progress but has enough functionality for people interested in looking at it to be

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Sean Hefty
Yes, but later. For now it is still being actively developed and is changing a lot. Once it settles down we plan to convert to patches and push up stream. Is there any commonality that can be shared between rxe and the qlogic driver? -- To unsubscribe from this list: send the line unsubscribe

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Robert Pearson
PM To: 'Robert Pearson'; 'Jason Gunthorpe'; 'frank zago' Cc: linux-rdma@vger.kernel.org; 'John Groves' Subject: RE: [Announce] rxe dev tree available (soft RDMAoE) Yes, but later. For now it is still being actively developed and is changing a lot. Once it settles down we plan to convert to patches

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Woodruff, Robert J
What is soft RDMA over ethernet, does this mean it is RDMAoE that will run over any ethernet interface that is installed in the system ? woody -Original Message- From: linux-rdma-ow...@vger.kernel.org [mailto:linux-rdma-ow...@vger.kernel.org] On Behalf Of frank zago Sent: Wednesday,

RE: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread fzago
Woodruff wrote: What is soft RDMA over ethernet, does this mean it is RDMAoE that will run over any ethernet interface that is installed in the system ? That's correct. Currently for every ethX interface present, it creates a corresponding rxeX device. These rxeX devices behaves the

Re: [Announce] rxe dev tree available (soft RDMAoE)

2009-12-16 Thread Dave Olson
On Wed, 16 Dec 2009, Roland Dreier wrote: | | Is there any commonality that can be shared between rxe and the qlogic driver? | | Interesting to note that according to ohcount, rxe is 9591 non-blank | non-comment lines of kernel code, while qib is 36957 lines. So the | complexity of IB