Re: [zeromq-dev] PUB-SUB Performance with 5000 subscriber

2018-11-01 Thread Hiren Shah
Somehow I had missed this option before ZMQ_IO_THREADS . Increasing IO
threads have help improve performance/throughput

On Sun, Oct 28, 2018 at 5:27 AM Doron Somech  wrote:

> If you are on your own network and multicast is an option you can try
> scatter-gather pattern and use multicast or PGM with pub-sub.
>
>
> On Fri, Oct 26, 2018 at 7:35 AM Justin Karneges 
> wrote:
>
>> 5000*500kb = 2.5gb. That's a lot of data. What throughput are you
>> expecting?
>>
>> On Thu, Oct 25, 2018, at 8:11 PM, Hiren Shah wrote:
>>
>> Notice there is significant increase in latency for bigger Message Size
>> when Number of subscriber increases.
>>
>> 4k Message size gets to all Subscriber in < 1sec but 500k Message Size
>> takes about 60sec.
>>
>> With Async IO and 5000 clients 500k message should be quite faster then
>> what I am seeing. I feel like I am missing option which I am setting.
>>
>>
>> *___*
>> zeromq-dev mailing list
>> zeromq-dev@lists.zeromq.org
>> https://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
>>
>> ___
>> zeromq-dev mailing list
>> zeromq-dev@lists.zeromq.org
>> https://lists.zeromq.org/mailman/listinfo/zeromq-dev
>>
> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> https://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
https://lists.zeromq.org/mailman/listinfo/zeromq-dev


[zeromq-dev] PUB-SUB Performance with 5000 subscriber

2018-10-25 Thread Hiren Shah
Notice there is significant increase in latency for bigger Message Size
when Number of subscriber increases.

4k Message size gets to all Subscriber in < 1sec but 500k Message Size
takes about 60sec.

With Async IO and 5000 clients 500k message should be quite faster then
what I am seeing. I feel like I am missing option which I am setting.
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
https://lists.zeromq.org/mailman/listinfo/zeromq-dev


Re: [zeromq-dev] PUB-SUB using XPUB-XSUB

2018-10-21 Thread Hiren Shah
Let me give example:

Today I have SUB which gets Messages from PUB_1 and PUB_2 - each one using
different key for Encryption.  SUB Connects to PUB_1 and PUB_2 both

If my understanding is correct if I switch to XPUB-XSUB now PUB_1/PUB_2
will connect to XPUB and SUB will connect to XPUB.

In this model SUB is only connecting to XPUB unlike previous where it was
connecting to PUB_1/PUB_2 so I was able to specify different set of key for
each PUB. Now SUB is only connecting to XPUB so I can only set one key.
Does that mean PUB_1 and PUB_2 needs to use same Keys ??









On Sun, Oct 21, 2018 at 5:26 PM Luca Boccassi 
wrote:

> On Sun, 21 Oct 2018, 22:16 Hiren Shah,  wrote:
>
>> Currently I already have PUB-SUB set-up with Curve Security.  I have
>> multiple PUB each using different key for encryption.
>>
>> I want to change it to use XPUB-XSUB which is straight forward. I don't
>> see example or documentation how to use XPUB-XSUB with
>> Encryption/Decryption (Curve Security). Each publisher is using different
>> Key.
>>
>
> There is no difference between them with regards to curve, so the exact
> same will work for xpub/xsub too.
>
>> ___
> zeromq-dev mailing list
> zeromq-dev@lists.zeromq.org
> https://lists.zeromq.org/mailman/listinfo/zeromq-dev
>
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
https://lists.zeromq.org/mailman/listinfo/zeromq-dev


[zeromq-dev] PUB-SUB using XPUB-XSUB

2018-10-21 Thread Hiren Shah
Currently I already have PUB-SUB set-up with Curve Security.  I have
multiple PUB each using different key for encryption.

I want to change it to use XPUB-XSUB which is straight forward. I don't see
example or documentation how to use XPUB-XSUB with Encryption/Decryption
(Curve Security). Each publisher is using different Key.
___
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
https://lists.zeromq.org/mailman/listinfo/zeromq-dev