[zeromq-dev] MDP protocol, detecting dead workers

2017-02-08 Thread Gyorgy Szekely
) message to a worker which will trigger EHOSTUNREACH for disconnected workers, but it will queue up in busy workers. I wouldn't even consider this as a workaround... Any ideas solve this correctly? Regards, Gyorgy Szekely ___ zeromq-dev mailing list zeromq

Re: [zeromq-dev] router socket hangs on write (was detecting dead MDP workers)

2017-02-19 Thread Gyorgy Szekely
bocca...@gmail.com> wrote: > On Fri, 2017-02-17 at 10:53 +0100, Gyorgy Szekely wrote: > > Hi, > > Sorry for spamming the list :( I will rate limit myself. > > > > I reviewed the docs for ZMQ_ROUTER_MANDATORY and it's clear now that > > the > > router s

Re: [zeromq-dev] router socket hangs on write (was detecting dead MDP workers)

2017-02-16 Thread Gyorgy Szekely
ory, that it will report EAGAIN, but this contradicts with the documentation. Can you help to clarify? Regards, Gyorgy It On Thu, Feb 16, 2017 at 12:22 PM, Gyorgy Szekely <hodito...@gmail.com> wrote: > Hi, > Continuing my journey on detecting dead workers I reduced the design t

Re: [zeromq-dev] MDP protocol, detecting dead workers

2017-02-14 Thread Gyorgy Szekely
Hi, The implemented protocol (ZMQ-RFC 7/MDP) has application level mutual heartbeating between the broker and the worker. And this works fine: both parties detect if the other side dies via missing heartbeats. The problem appears when the worker is assigned a long running job, heartbeating is

Re: [zeromq-dev] MDP protocol, detecting dead workers

2017-02-15 Thread Gyorgy Szekely
um time for a job, after which you consider > the worker dead. If not dead you can handle the reconnection then. > > On Feb 14, 2017 17:33, "Gyorgy Szekely" <hodito...@gmail.com> wrote: > >> Hi, >> The implemented protocol (ZMQ-RFC 7/MDP) has appl

Re: [zeromq-dev] router socket hangs on write (was detecting dead MDP workers)

2017-02-17 Thread Gyorgy Szekely
.) What's your opinion on this? Regards, Gyorgy On Thu, Feb 16, 2017 at 10:44 PM, Gyorgy Szekely <hodito...@gmail.com> wrote: > Hi, > I dug a bit deeper, here are my findings: > - removing the on/off switching for the ZMQ_ROUTER_MANDATORY flag, and > enabling it before the

[zeromq-dev] pub/sub pattern

2017-12-05 Thread Gyorgy Szekely
Hi ZeroMQ community, In our application we use ZeroMQ for communication between backend services and it works quite well (thanks for the awesome library). Up to now we relied on the request/reply pattern only (a majordomo derivative protocol), where a broker distributes tasks among workers.

Re: [zeromq-dev] pub/sub pattern

2017-12-07 Thread Gyorgy Szekely
who load balances for a scaling group. > > This all depends on volume and failure scenarios too. > > On Tue, Dec 5, 2017 at 5:38 AM Luca Boccassi <luca.bocca...@gmail.com> > wrote: > >> On Tue, 2017-12-05 at 09:03 +0100, Gyorgy Szekely wrote: >> > Hi ZeroMQ commun

Re: [zeromq-dev] pub/sub pattern

2017-12-09 Thread Gyorgy Szekely
, Dec 7, 2017 at 3:32 PM Gyorgy Szekely <hodito...@gmail.com> wrote: > >> Thanks guys for the answers. For some reason I didn't consider push-pull >> in the first place, but it suits my need quite well. :) >> >> My only concern is about recovery from failures. Let's

Re: [zeromq-dev] cppzmq revival and RFC on design goals and supported platforms

2018-05-23 Thread Gyorgy Szekely
Hi Simon, This is great news! We're using cppzmq in a message broker and an accompanying communication library for 2 years now. I fully agree with the declared goals. libzmq has a simple and concise API with object oriented mindset. It works well on its own, but cppzmq makes it a whole lot

Re: [zeromq-dev] Slow joiner syndrome solution for XSUB/XPUB broker based system

2018-05-28 Thread Gyorgy Szekely
Hi Tomer As far as I know the message from the publisher will reach the broker. According to the docs, the PUB socket drops messages in mute-state (HWM reached), and it's not the case here. The message will be sent as soon as the connection is established, and the socket termination blocks until

[zeromq-dev] Linger vs inproc

2018-04-05 Thread Gyorgy Szekely
put queue. Is this true? Regards, Gyorgy Szekely ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev

[zeromq-dev] Migrate app to threadsafe sockets

2019-11-30 Thread Gyorgy Szekely
iovector based functions, but I don't think it's good idea to start building new code on these... (do they work at all with threadsafe sockets?) Any other idea, comments? Regards, Gyorgy Szekely ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org

[zeromq-dev] Flow control with router socket

2020-05-14 Thread Gyorgy Szekely
ducers... Is there any better way to do this? I would rather not reinvent the wheel, TCP already has a sophisticated mechanism for this. Regards, Gyorgy Szekely ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Flow control with router socket

2020-05-14 Thread Gyorgy Szekely
Thank you guys for the answers! That's plenty of information to get me going. Regards, Gyorgy Szekely On Thu, May 14, 2020 at 6:13 PM Brett Viren wrote: > I was going to reply similarly. Once a message is outside a socket, > it's out of ZeroMQ's hands and the responsi