[
https://issues.apache.org/jira/browse/QPID-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14255383#comment-14255383
]
An Yang commented on QPID-6282:
-------------------------------
The max-frame-size is 65535, it limits the performance of RDMA, the max message
size in RDMA RC mode is 1GB, if qpid support uint32 max-frame-size, it will
reach the line speed of RDMA.
> low performance sending big message with RDMA transport agent
> -------------------------------------------------------------
>
> Key: QPID-6282
> URL: https://issues.apache.org/jira/browse/QPID-6282
> Project: Qpid
> Issue Type: Wish
> Components: C++ Broker
> Affects Versions: 0.22
> Environment: RHEL6.6/CentOS6.6 64bits, Mellanox ConnectX-3 dual port
> FDR 56Gbps IB cards, qpid packages from MRG-clone
> http://glitesoft.cern.ch/cern/mrg/slc6X/x86_64/RPMS/
> Reporter: An Yang
> Labels: maxframesize, qpid, rdma
>
> Transferring large messages, the message size is more than 120MB, it will
> cost over 250ms.
> qperf -m 120m serverip，it said:
> [root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 tcp_lat
> tcp_lat:
> latency = 58.8 ms
> [root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 tcp_bw
> tcp_bw:
> bw = 2.82 GB/sec
> [root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 rc_lat
> rc_lat:
> latency = 20.6 ms
> [root@node2 qpid-benchmark]# qperf -m 120m 192.168.1.1 rc_bw
> rc_bw:
> bw = 5.82 GB/sec
> [root@node2 qpid-benchmark]#
> I use the following cmds:
> qpid-send -b 'amqp:rdma:192.168.1.1' -a 'benchmark-0;{create:always}'
> --report-total --report-header=no --timestamp=yes --sequence=no --durable
> False --connection-options '{tcp-nodelay:true,reconnect:true,heartbeat:1}'
> --messages 0 --content-size 120240000 --send-rate 1
> qpid-receive -b 'amqp:rdma:192.168.1.1' -a 'benchmark-0;{create:always}'
> --print-content no -f --report-every 3 --receive-rate 2
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
