Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Evgeniy Polyakov
On Sun, Aug 19, 2007 at 05:47:59PM -0700, Felix Marti ([EMAIL PROTECTED]) wrote: [Felix Marti] David and Herbert, so you agree that the userkernel space memory copy overhead is a significant overhead and we want to enable zero-copy in both the receive and transmit path? - Yes, copy It depends.

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Andi Kleen
Felix Marti [EMAIL PROTECTED] writes: avoidance gains of TSO and LRO are still a very worthwhile savings. So, i.e. with TSO, your saving about 16 headers (let us say 14 + 20 + 20), 864B, when moving ~64KB of payload - looks like very much in the noise to me. TSO is beneficial for the

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Felix Marti
PROTECTED] Subject: Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. Felix Marti [EMAIL PROTECTED] writes: avoidance gains of TSO and LRO are still a very worthwhile savings. So, i.e. with TSO, your saving about 16 headers (let us say 14 + 20

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Felix Marti
: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. On Sun, Aug 19, 2007 at 05:47:59PM -0700, Felix Marti ([EMAIL PROTECTED]) wrote: [Felix Marti] David and Herbert, so you agree that the userkernel space memory copy overhead is a significant overhead

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Andi Kleen
Felix Marti [EMAIL PROTECTED] writes: What I was referring to is that TSO(/LRO) have their own issues, some eluded to by Roland and me. In fact, customers working on the LSR couldn't use TSO due to the burstiness it introduces That was in old kernels where TSO didn't honor the initial cwnd

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Felix Marti
Miller Subject: Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. Felix Marti [EMAIL PROTECTED] writes: What I was referring to is that TSO(/LRO) have their own issues, some eluded to by Roland and me. In fact, customers working on the LSR

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Rick Jones
Andi Kleen wrote: TSO is beneficial for the software again. The linux code currently takes several locks and does quite a few function calls for each packet and using larger packets lowers this overhead. At least with 10GbE saving CPU cycles is still quite important. Some quick netperf

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Thomas Graf
* Felix Marti [EMAIL PROTECTED] 2007-08-20 12:02 These graphic adapters provide a wealth of features that you can take advantage of to bring these amazing graphics to life. General purpose CPUs cannot keep up. Chelsio offload devices do the same thing in the realm of networking. - Will there

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Andi Kleen
GPUs have almost no influence on system security, Unless you use direct rendering from user space. -Andi - To unsubscribe from this list: send the line unsubscribe netdev in the body of a message to [EMAIL PROTECTED] More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Patrick Geoffray
Felix Marti wrote: Yes, the app will take the cache hits when accessing the data. However, the fact remains that if there is a copy in the receive path, you require and additional 3x memory BW (which is very significant at these high rates and most likely the bottleneck for most current

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-20 Thread Felix Marti
] Subject: Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. Felix Marti wrote: Yes, the app will take the cache hits when accessing the data. However, the fact remains that if there is a copy in the receive path, you require and additional 3x memory

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Felix Marti
: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. From: Sean Hefty [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 00:01:07 -0700 Millions of Infiniband ports are in operation today. Over 25% of the top 500 supercomputers use Infiniband. The formation

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread David Miller
From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 10:33:31 -0700 I know that you don't agree that TSO has drawbacks, as outlined by Roland, but its history showing something else: the addition of TSO took a fair amount of time and network performance was erratic for multiple kernel

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Felix Marti
RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 10:33:31 -0700 I know that you don't agree that TSO has drawbacks, as outlined by Roland, but its history showing something else: the addition of TSO took a fair

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Andi Kleen
Felix Marti [EMAIL PROTECTED] writes: what benefits does the TSO infrastructure give the non-TSO capable devices? It improves performance on software queueing devices between guests and hypervisors. This is a more and more important application these days. Even when the system running the

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread David Miller
From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 12:49:05 -0700 You're not at all addressing the fact that RDMA does solve the memory BW problem and stateless offload doesn't. It does, I just didn't retort to your claims because they were so blatantly wrong. - To unsubscribe from

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread David Miller
From: Andi Kleen [EMAIL PROTECTED] Date: 20 Aug 2007 01:27:35 +0200 Felix Marti [EMAIL PROTECTED] writes: what benefits does the TSO infrastructure give the non-TSO capable devices? It improves performance on software queueing devices between guests and hypervisors. This is a more and

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Herbert Xu
Felix Marti [EMAIL PROTECTED] wrote: [Felix Marti] Aren't you confusing memory and bus BW here? - RDMA enables DMA from/to application buffers removing the user-to-kernel/ kernel-to-user memory copy with is a significant overhead at the rates we're talking about: memory copy at 20Gbps

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Felix Marti
RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 12:49:05 -0700 You're not at all addressing the fact that RDMA does solve the memory BW problem and stateless offload doesn't. It does, I just didn't retort to your

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread David Miller
From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 17:32:39 -0700 [ Why do you put that [Felix Marti] everywhere you say something? It's annoying and superfluous. The quoting done by your mail client makes clear who is saying what. ] Hmmm, interesting... I guess it is impossible to

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Felix Marti
RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 17:32:39 -0700 [ Why do you put that [Felix Marti] everywhere you say something? It's annoying and superfluous. The quoting done by your mail client makes clear who

Re: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread David Miller
From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 17:47:59 -0700 [Felix Marti] Please stop using this to start your replies, thank you. David and Herbert, so you agree that the userkernel space memory copy overhead is a significant overhead and we want to enable zero-copy in both

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Felix Marti
RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. From: Felix Marti [EMAIL PROTECTED] Date: Sun, 19 Aug 2007 17:47:59 -0700 [Felix Marti] Please stop using this to start your replies, thank you. Better? David and Herbert, so you agree that the userkernel space memory

RE: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space.

2007-08-19 Thread Felix Marti
: [ofa-general] Re: [PATCH RFC] RDMA/CMA: Allocate PS_TCPportsfrom the host TCP port space. Felix Marti [EMAIL PROTECTED] writes: what benefits does the TSO infrastructure give the non-TSO capable devices? It improves performance on software queueing devices between guests and hypervisors