Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-17 Thread Sagi Grimberg
On 7/16/2013 6:11 PM, Bart Van Assche wrote: On 14/07/2013 3:43, Sagi Grimberg wrote: Just wrote a small patch to allow srp_daemon spread connection across HCA's completion vectors. Hello Sagi, How about the following approach: - Add support for reading the completion vector from

Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-16 Thread Sagi Grimberg
On 7/15/2013 9:23 PM, Bart Van Assche wrote: On 15/07/2013 7:29, Sagi Grimberg wrote: srp_daemon is a package designated for the customer to automatically detect targets in the IB fabric. From our experience here in Mellanox, customers/users like automatic plugplay tools. They are reluctant to

Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-16 Thread Bart Van Assche
On 16/07/2013 4:11, Sagi Grimberg wrote: This sounds like a nice Idea, but there an inherent problem about applications coming and going while the connections are static (somewhat), how can you control pinning an arbitrary application running (over SRP devices of-course) at certain point of

Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-16 Thread Sagi Grimberg
On 7/16/2013 1:58 PM, Bart Van Assche wrote: On 16/07/2013 4:11, Sagi Grimberg wrote: This sounds like a nice Idea, but there an inherent problem about applications coming and going while the connections are static (somewhat), how can you control pinning an arbitrary application running (over

Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-16 Thread Bart Van Assche
On 14/07/2013 3:43, Sagi Grimberg wrote: Just wrote a small patch to allow srp_daemon spread connection across HCA's completion vectors. Hello Sagi, How about the following approach: - Add support for reading the completion vector from srp_daemon.conf, similar to how several other

Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-15 Thread Bart Van Assche
On 14/07/2013 3:43, Sagi Grimberg wrote: On 7/3/2013 3:58 PM, Bart Van Assche wrote: Several InfiniBand HCA's allow to configure the completion vector per queue pair. This allows to spread the workload created by IB completion interrupts over multiple MSI-X vectors and hence over multiple CPU

Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-15 Thread Sagi Grimberg
On 7/15/2013 2:06 PM, Bart Van Assche wrote: On 14/07/2013 3:43, Sagi Grimberg wrote: On 7/3/2013 3:58 PM, Bart Van Assche wrote: Several InfiniBand HCA's allow to configure the completion vector per queue pair. This allows to spread the workload created by IB completion interrupts over

Re: [PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-15 Thread Bart Van Assche
On 15/07/2013 7:29, Sagi Grimberg wrote: srp_daemon is a package designated for the customer to automatically detect targets in the IB fabric. From our experience here in Mellanox, customers/users like automatic plugplay tools. They are reluctant to build their own scriptology to enhance

[PATCH v3 11/13] IB/srp: Make HCA completion vector configurable

2013-07-03 Thread Bart Van Assche
Several InfiniBand HCA's allow to configure the completion vector per queue pair. This allows to spread the workload created by IB completion interrupts over multiple MSI-X vectors and hence over multiple CPU cores. In other words, configuring the completion vector properly not only allows to