Got the problem solved. One of the machines had the auto scaling option disabled. I enabled it and also set big value to the sender\receiver buffer size and I got much higher QPS now.
Thanks, Ori -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Ori Barak Sent: Wednesday, June 26, 2013 7:02 PM To: ZeroMQ development list Subject: Re: [zeromq-dev] ZMQ TCP optimization Hi, Thanks for the help Martin, Enclosed are first couple in pcapng format hope it's fine. It looks as if windo size scaling factor is -2 (no window scaling used). I've tried not using the SND\RECVBUF option and also tried setting it with very high value but didn't see any difference. Thanks, Ori -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Martin Hurton Sent: Wednesday, June 26, 2013 2:37 PM To: ZeroMQ development list Subject: Re: [zeromq-dev] ZMQ TCP optimization Hi Ori, could you please capture the first 10 packets when you connect to the remote server for me. I would like to check something. Thanks. - mh On Wed, Jun 26, 2013 at 10:05 AM, Ori Barak <[email protected]> wrote: > Hi, > > > > I have an application running on windows using ZMQ Push\Pull TCP sockets. > > The client\server machines I use have a 1 GB bandwidth. > > When sending messages between 2 close servers (round trip time <1ms) I > get a rate of about ~110MB/sec. When sending messages between two > remote servers (round trip ~70ms) I get ~1.5MB/sec. I was under the > impression that the RTT shouldn't affect much on the throughput since > the TCP window scaling option is enabled in windows by default > (http://en.wikipedia.org/wiki/TCP_window_scale_option ) thus window > size can increase up to 1,073,725,440 bytes which basically means the > RTT should have little effect. > > > > If I open multiple channels on the client side on the same destination > port I can get more utilization but I would rather have a single > channel working faster. > > > > Any ZMQ\TCP configuration I can change to increase network utilization? > > > > Thanks, > > Ori > > > > > > > _______________________________________________ > zeromq-dev mailing list > [email protected] > http://lists.zeromq.org/mailman/listinfo/zeromq-dev > _______________________________________________ zeromq-dev mailing list [email protected] http://lists.zeromq.org/mailman/listinfo/zeromq-dev _______________________________________________ zeromq-dev mailing list [email protected] http://lists.zeromq.org/mailman/listinfo/zeromq-dev
