Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-22 Thread Maged Mokhtar
On 2018-01-23 08:27, Blair Bethwaite wrote: > Firstly, the OP's premise in asking, "Or should there be a differnce > of 10x", is fundamentally incorrect. Greater bandwidth does not mean > lower latency, though the latter almost always results in the former. > Unfortunately, changing the speed of

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-22 Thread Blair Bethwaite
Firstly, the OP's premise in asking, "Or should there be a differnce of 10x", is fundamentally incorrect. Greater bandwidth does not mean lower latency, though the latter almost always results in the former. Unfortunately, changing the speed of light remains a difficult engineering challenge :-).

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-22 Thread Konstantin Shalygin
ping -c 10 -f 10.0.1.12 Intel X710-DA2 -> Switch -> Intel X710-DA2: --- 172.16.16.3 ping statistics --- 10 packets transmitted, 10 received, 0% packet loss, time 1932ms rtt min/avg/max/mdev = 0.013/0.014/0.131/0.004 ms, ipg/ewma 0.019/0.014 ms k

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-22 Thread Warren Wang
25Gbe network. Servers have ConnectX-4 Pro, across a router, since L2 is terminated as the ToR: 10 packets transmitted, 10 received, 0% packet loss, time 1926ms rtt min/avg/max/mdev = 0.013/0.013/0.205/0.004 ms, ipg/ewma 0.019/0.014 ms Warren Wang On 1/22/18, 4:06 PM, "ceph-users on

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-22 Thread Marc Roos
ping -c 10 -f ping -M do -s 8972 10Gb ConnectX-3 Pro, DAC + Vlan rtt min/avg/max/mdev = 0.010/0.013/0.200/0.003 ms, ipg/ewma 0.025/0.014 ms 8980 bytes from 10.0.0.11: icmp_seq=3 ttl=64 time=0.144 ms 8980 bytes from 10.0.0.11: icmp_seq=4 ttl=64 time=0.205 ms 8980 bytes from 10.0.0.11:

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-22 Thread Nick Fisk
Anyone with 25G ethernet willing to do the test? Would love to see what the latency figures are for that. From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Maged Mokhtar Sent: 22 January 2018 11:28 To: ceph-users@lists.ceph.com Subject: Re: [ceph-users] What is the

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-22 Thread Maged Mokhtar
On 2018-01-22 08:39, Wido den Hollander wrote: > On 01/20/2018 02:02 PM, Marc Roos wrote: > >> If I test my connections with sockperf via a 1Gbit switch I get around >> 25usec, when I test the 10Gbit connection via the switch I have around >> 12usec is that normal? Or should there be a

Re: [ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-21 Thread Wido den Hollander
On 01/20/2018 02:02 PM, Marc Roos wrote: If I test my connections with sockperf via a 1Gbit switch I get around 25usec, when I test the 10Gbit connection via the switch I have around 12usec is that normal? Or should there be a differnce of 10x. No, that's normal. Tests with 8k ping

[ceph-users] What is the should be the expected latency of 10Gbit network connections

2018-01-20 Thread Marc Roos
If I test my connections with sockperf via a 1Gbit switch I get around 25usec, when I test the 10Gbit connection via the switch I have around 12usec is that normal? Or should there be a differnce of 10x. sockperf ping-pong sockperf: Warmup stage (sending a few dummy messages)... sockperf: