Re: [zeromq-dev] PUB-SUB Performance with 5000 subscriber
Somehow I had missed this option before ZMQ_IO_THREADS . Increasing IO threads have help improve performance/throughput On Sun, Oct 28, 2018 at 5:27 AM Doron Somech wrote: > If you are on your own network and multicast is an option you can try > scatter-gather pattern and use multicast or PGM with pub-sub. > > > On Fri, Oct 26, 2018 at 7:35 AM Justin Karneges > wrote: > >> 5000*500kb = 2.5gb. That's a lot of data. What throughput are you >> expecting? >> >> On Thu, Oct 25, 2018, at 8:11 PM, Hiren Shah wrote: >> >> Notice there is significant increase in latency for bigger Message Size >> when Number of subscriber increases. >> >> 4k Message size gets to all Subscriber in < 1sec but 500k Message Size >> takes about 60sec. >> >> With Async IO and 5000 clients 500k message should be quite faster then >> what I am seeing. I feel like I am missing option which I am setting. >> >> >> *___* >> zeromq-dev mailing list >> zeromq-dev@lists.zeromq.org >> https://lists.zeromq.org/mailman/listinfo/zeromq-dev >> >> >> ___ >> zeromq-dev mailing list >> zeromq-dev@lists.zeromq.org >> https://lists.zeromq.org/mailman/listinfo/zeromq-dev >> > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev
[zeromq-dev] PUB-SUB Performance with 5000 subscriber
Notice there is significant increase in latency for bigger Message Size when Number of subscriber increases. 4k Message size gets to all Subscriber in < 1sec but 500k Message Size takes about 60sec. With Async IO and 5000 clients 500k message should be quite faster then what I am seeing. I feel like I am missing option which I am setting. ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev
Re: [zeromq-dev] PUB-SUB using XPUB-XSUB
Let me give example: Today I have SUB which gets Messages from PUB_1 and PUB_2 - each one using different key for Encryption. SUB Connects to PUB_1 and PUB_2 both If my understanding is correct if I switch to XPUB-XSUB now PUB_1/PUB_2 will connect to XPUB and SUB will connect to XPUB. In this model SUB is only connecting to XPUB unlike previous where it was connecting to PUB_1/PUB_2 so I was able to specify different set of key for each PUB. Now SUB is only connecting to XPUB so I can only set one key. Does that mean PUB_1 and PUB_2 needs to use same Keys ?? On Sun, Oct 21, 2018 at 5:26 PM Luca Boccassi wrote: > On Sun, 21 Oct 2018, 22:16 Hiren Shah, wrote: > >> Currently I already have PUB-SUB set-up with Curve Security. I have >> multiple PUB each using different key for encryption. >> >> I want to change it to use XPUB-XSUB which is straight forward. I don't >> see example or documentation how to use XPUB-XSUB with >> Encryption/Decryption (Curve Security). Each publisher is using different >> Key. >> > > There is no difference between them with regards to curve, so the exact > same will work for xpub/xsub too. > >> ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org > https://lists.zeromq.org/mailman/listinfo/zeromq-dev > ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev
[zeromq-dev] PUB-SUB using XPUB-XSUB
Currently I already have PUB-SUB set-up with Curve Security. I have multiple PUB each using different key for encryption. I want to change it to use XPUB-XSUB which is straight forward. I don't see example or documentation how to use XPUB-XSUB with Encryption/Decryption (Curve Security). Each publisher is using different Key. ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev