Re: [Lustre-discuss] [HPDD-discuss] Same performance Infiniband and Ethernet

2014-05-21 Thread Pardo Diaz, Alfonso
Thanks Richard, I appreciate your advice. I was able to sature the channel using: XDD, 10 threads writing in 10 OST, each OST in difference OSS and this is the result: ETHERNET T Q Bytes Ops Time Rate IOPS Latency

Re: [Lustre-discuss] [HPDD-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Dilger, Andreas
Are you sure your client is using the IB network? What does: lctl get_param osc.*.imports report for the NIDs of the OSTs? If it is still using the TCP connection you may need to run writeconf to fix the client config log. Cheers, Andreas On May 19, 2014, at 4:34, Pardo Diaz, Alfonso

Re: [Lustre-discuss] [HPDD-discuss] Same performance Infiniband and Ethernet

2014-05-19 Thread Mohr Jr, Richard Frank (Rick Mohr)
Alfonso, Based on my attempts to benchmark single client Lustre performance, here is some advice/comments that I have. (YMMV) 1) On the IB client, I recommend disabling checksums (lctl set_param osc.*.checksums=0). Having checksums enabled sometimes results in a significant performance hit.