Re: [zeromq-dev] pyzmq issue: _pickle.UnpicklingError: pickle data was truncated

2023-10-12 Thread Goswin von Brederlow
Hi, On 10/12/23 16:05, CZ wrote: I am running some python project based on client/server framework. It is something like rpclient/rpcserver. pyzmq is a very important part of this project. Now we are running into some trouble because of some errors in pyzmq. Please refer to the following

[zeromq-dev] How to close a pipes peer?

2022-07-16 Thread Goswin von Brederlow
Hi, I'm trying to fix the FD leaks in router sockets with HANDOVER. This happens in zmq::router_t::identify (pipe_t *pipe_, bool locally_initiated_) right at the end with a call to old_pipe->terminate (true); This terminates the obsolete old_pipe. But it does nothing to the peer of

Re: [zeromq-dev] CZMQ community red cards

2014-10-16 Thread Goswin von Brederlow
On Thu, Oct 16, 2014 at 05:37:54PM +0200, Benjamin wrote: For me, misleading and hiding are quite strong words, and griwes rant did not help. They are just words. Strong, weak? I'm not a walking theasurus or whatever that thing is called that lists lots of words meaning the same thing. I write

Re: [zeromq-dev] CurveZMQ Enhancements

2014-10-02 Thread Goswin von Brederlow
On Wed, Oct 01, 2014 at 08:36:28PM +0200, Pieter Hintjens wrote: On Wed, Oct 1, 2014 at 7:21 PM, Matthew Hawn matth...@donaanacounty.org wrote: Message Size Limits It behooves a pubic server to not accept large messages until authentication happens. Good idea. Does not affect the

Re: [zeromq-dev] Friendly IDs

2014-09-30 Thread Goswin von Brederlow
that corresponds to Jerry, and how can it route to it? On Mon, Sep 29, 2014 at 2:21 AM, Goswin von Brederlow goswin-...@web.de wrote: On Sun, Sep 28, 2014 at 07:17:39PM -0700, Roberto Ostinelli wrote: Hello 0mq'ers! I'm investigating 0MQ and up until know I'm enjoying what I'm seeing

Re: [zeromq-dev] Friendly IDs

2014-09-29 Thread Goswin von Brederlow
On Sun, Sep 28, 2014 at 07:17:39PM -0700, Roberto Ostinelli wrote: Hello 0mq'ers! I'm investigating 0MQ and up until know I'm enjoying what I'm seeing. As an academical exercise, I'm trying to understand how to build a simple server that can route a REQ to a very specific Socket based on a

Re: [zeromq-dev] ELI5: Why can't I get the IP address of the machine that sent a message?

2014-09-27 Thread Goswin von Brederlow
On Sat, Sep 27, 2014 at 08:36:47AM -0700, Scott wrote: Understand and agree with all of the above re: IP address. However, some sort of 'source transport specific information' (there's always some unique identifier associated w/ the transport) could be useful (sometimes it would be IP

[zeromq-dev] [g...@debian.org: Re: Bug#743508: libzmq3: upgrading from 3.2.3 to 4.0.4 breaks python-pytango]

2014-09-26 Thread Goswin von Brederlow
- Forwarded message from László Böszörményi (GCS) g...@debian.org - Date: Thu, 25 Sep 2014 09:48:03 +0200 From: László Böszörményi (GCS) g...@debian.org To: Goswin von Brederlow goswin-...@web.de, 743...@bugs.debian.org Subject: Re: Bug#743508: libzmq3: upgrading from 3.2.3 to 4.0.4

Re: [zeromq-dev] DEALER-ROUTER question

2014-09-26 Thread Goswin von Brederlow
On Fri, Sep 26, 2014 at 09:51:50AM +0200, Pieter Hintjens wrote: On Fri, Sep 26, 2014 at 3:10 AM, Goswin von Brederlow goswin-...@web.de wrote: Pieter: Would it be possible to put all the examples of the guide into a git project and have them included in the auto compile done for every

Re: [zeromq-dev] ZMQ_POLLIN received on WRITE event

2014-09-26 Thread Goswin von Brederlow
On Fri, Sep 26, 2014 at 09:51:40AM +0200, Dorvin wrote: W dniu 2014-09-25 13:54, Goswin von Brederlow pisze: It might help if you would post a testcase that: a) actualy compiles It actualy compiles on Windows. I think I should state it more clearly in first post. With the includes

Re: [zeromq-dev] ZMQ_POLLIN received on WRITE event

2014-09-26 Thread Goswin von Brederlow
On Fri, Sep 26, 2014 at 09:55:59AM +0200, Dorvin wrote: W dniu 2014-09-26 02:05, KIU Shueng Chuan pisze: Your code could be stripped down a lot: 1) PUB socket is only for sending. There's no need to test it for ZMQ_POLLIN. 2) PUB socket never blocks when sending. There's no need to test

Re: [zeromq-dev] DEALER-ROUTER question

2014-09-26 Thread Goswin von Brederlow
On Fri, Sep 26, 2014 at 11:06:29AM +0200, Pieter Hintjens wrote: This is one of those rare roadmap / vision threads. Concretely all this has to happen first: - release 4.0.5 sometime very soon - release 4.1.0 RC sometime later - update Guide for 4.1 - release CZMQ v3.0 RC I think CZMQ

Re: [zeromq-dev] ZMQ_POLLIN received on WRITE event

2014-09-26 Thread Goswin von Brederlow
On Fri, Sep 26, 2014 at 11:25:37AM +0200, Dorvin wrote: W dniu 2014-09-26 10:39, Goswin von Brederlow pisze: a) actualy compiles It actualy compiles on Windows. I think I should state it more clearly in first post. With the includes for FD_SET missing and Sleep() undefined? I

Re: [zeromq-dev] DEALER-ROUTER question

2014-09-26 Thread Goswin von Brederlow
On Fri, Sep 26, 2014 at 01:46:20PM +0200, Pieter Hintjens wrote: On Fri, Sep 26, 2014 at 11:36 AM, Goswin von Brederlow goswin-...@web.de wrote: One last thing and then I will get back to work. Ah, work, that mysterious thing we do when we're not talking about it :-) The zring class

Re: [zeromq-dev] DEALER-ROUTER question

2014-09-26 Thread Goswin von Brederlow
On Fri, Sep 26, 2014 at 06:34:32PM +0200, Pieter Hintjens wrote: On Fri, Sep 26, 2014 at 6:20 PM, Goswin von Brederlow goswin-...@web.de wrote: Do you actually need it? After all the work, that's a sad question. What I see are too-large patches done in I want to try this yet I've

[zeromq-dev] Reimplementation of the zring class with equipotent API

2014-09-26 Thread Goswin von Brederlow
Hi, I just send a pull request for a reimplementation of the zring class with a new API: https://github.com/zeromq/czmq/pull/698 Note: I renamed the existing zring class to zhashring in case that is still wanted by others. The ztimeout class, for which I write the initial zring class,

Re: [zeromq-dev] libzmq v4.0.5

2014-09-25 Thread Goswin von Brederlow
On Thu, Sep 25, 2014 at 09:00:28AM +0200, Pieter Hintjens wrote: On Thu, Sep 25, 2014 at 4:22 AM, Goswin von Brederlow goswin-...@web.de wrote: Well, and a third time now. Both the now blocks and changed monitor events are API changes that breaks existing stuff. One could even say

Re: [zeromq-dev] ZMQ_POLLIN received on WRITE event

2014-09-25 Thread Goswin von Brederlow
On Thu, Sep 25, 2014 at 11:09:15AM +0200, Dorvin wrote: Thank you for your replies so far. I'll clarify if it does matter that I'm using Windows and libzmq 4.0.4. W dniu 2014-09-25 04:38, Goswin von Brederlow pisze: the ØMQ library shall signal any pending events on the socket

Re: [zeromq-dev] Is my use case viable?

2014-09-25 Thread Goswin von Brederlow
On Thu, Sep 25, 2014 at 01:49:13PM +0200, Arnaud Kapp wrote: Hello everyone, Not too long ago I asked about POLLPRI being handled by ZMQ for a particular project i'm working on. I am still figuring out if ZMQ would be a good fit in this project. I would like your feedback about my use case,

Re: [zeromq-dev] DEALER-ROUTER question

2014-09-25 Thread Goswin von Brederlow
On Thu, Sep 25, 2014 at 02:08:41PM +0100, Riskybiz wrote: Dear Pieter, As a figurehead of the zeromq project I think you should know that the Maybe you ment spokesperson or prominent programmers instead of figurehead? I assume you didn't ment Pieter is just a puppet. zguide and its

Re: [zeromq-dev] libzmq v4.0.5

2014-09-25 Thread Goswin von Brederlow
On Thu, Sep 25, 2014 at 02:20:07PM +0200, Pieter Hintjens wrote: On Thu, Sep 25, 2014 at 1:39 PM, Goswin von Brederlow goswin-...@web.de wrote: That is fine for major changes where a completly new function makes sense. But not for minor behaviour changes that only conern corner cases

Re: [zeromq-dev] libzmq v4.0.5

2014-09-24 Thread Goswin von Brederlow
On Mon, Sep 22, 2014 at 12:13:48AM +0200, Pieter Hintjens wrote: Hi all, This is a pre-release announcement, to give time for backporting. If there are any fixes on libzmq master that you'd like to see in 4.0.5, please let us know. For info, this is what's currently in that release: *

Re: [zeromq-dev] libzmq v4.0.5

2014-09-24 Thread Goswin von Brederlow
methods. This is what CZMQ is experimenting with. These classes can move into libzmq if that's valuable. On Wed, Sep 24, 2014 at 8:33 AM, Goswin von Brederlow goswin-...@web.de wrote: On Mon, Sep 22, 2014 at 12:13:48AM +0200, Pieter Hintjens wrote: Hi all, This is a pre-release

Re: [zeromq-dev] ZMQ_POLLIN received on WRITE event

2014-09-24 Thread Goswin von Brederlow
On Wed, Sep 24, 2014 at 07:51:39PM +0200, Dorvin wrote: Hi, I started using ZeroMQ not long ago and tried to use it in evented app. When I try to use FD with socket notifier it appears I'm receiving ZMQ_POLLIN events when FD is signalling write event. Is there any rationale behind such

Re: [zeromq-dev] ELI5: Why can't I get the IP address of the machine that sent a message?

2014-09-24 Thread Goswin von Brederlow
On Wed, Sep 24, 2014 at 07:03:25PM -0700, Michel Pelletier wrote: IP addresses are easily spoofed, they should not be used as a security mechanism. If you want security, you have to either trust all your networks or use curvemq security or some other authentication mechanism like a vpn.

Re: [zeromq-dev] It looks like socket id's can't change with a router-router topology. Is that correct?

2014-09-18 Thread Goswin von Brederlow
On Wed, Sep 17, 2014 at 03:55:09PM -0400, Mark Wright wrote: I have a router-router setup (destination IDs are acquired via a broadcast/response, similar to the Freelance pattern in the ZMQ book). I've noticed that if my destinations go down and come back up with a new ID, clients can't

Re: [zeromq-dev] Multiple Router/Dealer

2014-09-15 Thread Goswin von Brederlow
On Fri, Sep 12, 2014 at 11:49:03AM -0700, Mohit Anchlia wrote: For my testing I've built a client (req) - router - dealer - worker (rep). I currently have multiple clients and workers, however I am trying to figure out how I can have multiple router/dealers. Is there a way to make

Re: [zeromq-dev] Proposal for a revised zlist API

2014-09-12 Thread Goswin von Brederlow
On Wed, Sep 10, 2014 at 06:42:18PM +0200, Pieter Hintjens wrote: Sorry, I've lost track of some of the details here. Could you re-describe your timeout queue starting from the problem so I can think about how I'd implement it? Thanks Pieter The problem is that every connected host has a

Re: [zeromq-dev] Router socket and connection identities?

2014-09-12 Thread Goswin von Brederlow
On Fri, Sep 12, 2014 at 09:00:02AM +0100, Riskybiz wrote: Dear zeromq developers, I intend to create an example DEALER-ROUTER network arrangement which will pass multipart messages containing a variable number of parts. As I understand it a ROUTER socket uses an

Re: [zeromq-dev] Proposal for a revised zlist API

2014-09-10 Thread Goswin von Brederlow
On Mon, Sep 08, 2014 at 07:02:53PM +0200, Pieter Hintjens wrote: On Mon, Sep 8, 2014 at 6:42 PM, Goswin von Brederlow goswin-...@web.de wrote: Urgs. :-) If zlist gets deprecated then there needs to be a new list (zring) that preserves the strict fifo ordering and simplicity

Re: [zeromq-dev] Automatic reconnection, blessing or curse?

2014-09-10 Thread Goswin von Brederlow
At work we leave GUI clients running connected to remote servers via ZMQ all the time. But when we go home at night our local system get suspended. When we come back in the morning and wake them up again the GUI clients just keeps working because zmq will reconnect in the background. So that is

Re: [zeromq-dev] Proposal for a revised zlist API

2014-09-08 Thread Goswin von Brederlow
On Fri, Sep 5, 2014 at 7:14 PM, Goswin von Brederlow goswin-...@web.de wrote: On Fri, Sep 05, 2014 at 05:49:20PM +0200, Pieter Hintjens wrote: On Fri, Sep 5, 2014 at 3:56 PM, Goswin von Brederlow goswin-...@web.de wrote: Just saw your commit. You only found 17 issues? :-) I

Re: [zeromq-dev] Proposal for a revised zlist API

2014-09-05 Thread Goswin von Brederlow
changes one by one. Breaking the v2 API is not an option, and renaming zlist to another name isn't plausible either IMO. So we may rename some methods, like zlist_dup, which make broken assumptions (autofree, in that case). -Pieter On Thu, Sep 4, 2014 at 5:38 PM, Goswin von Brederlow goswin

Re: [zeromq-dev] CZMQ: Error checking of z*_new() calls in other z*_new() functions

2014-09-05 Thread Goswin von Brederlow
might be neat. Or a series of chained if statements. I'll experiment... On Thu, Sep 4, 2014 at 4:06 PM, Goswin von Brederlow goswin-...@web.de wrote: On Thu, Sep 04, 2014 at 11:51:27AM +0200, Pieter Hintjens wrote: I'd prefer assertions in most places. The problem is that adding full

Re: [zeromq-dev] Proposal for a revised zlist API

2014-09-05 Thread Goswin von Brederlow
On Fri, Sep 05, 2014 at 03:56:56PM +0200, Goswin von Brederlow wrote: 12) Can we add the void *user argument to czmq_destructor and czmq_comparator? That would be realy usefull for keeping items in 2 container like zcertstore does among other things. czmq_destructor and czmq_duplicator I mean

Re: [zeromq-dev] Proposal for a revised zlist API

2014-09-05 Thread Goswin von Brederlow
On Fri, Sep 05, 2014 at 05:49:20PM +0200, Pieter Hintjens wrote: On Fri, Sep 5, 2014 at 3:56 PM, Goswin von Brederlow goswin-...@web.de wrote: Just saw your commit. You only found 17 issues? :-) I was coding till 1am, surprising it worked at all. 1) Small typos Fixed. 2

Re: [zeromq-dev] CZMQ: Error checking of z*_new() calls in other z*_new() functions

2014-09-04 Thread Goswin von Brederlow
On Thu, Sep 04, 2014 at 11:51:27AM +0200, Pieter Hintjens wrote: I'd prefer assertions in most places. The problem is that adding full error handling on every allocation creates more complex code and overall increases the risk of other errors. There are a few places where it's worth catching

[zeromq-dev] Proposal for a revised zlist API

2014-09-04 Thread Goswin von Brederlow
Hi, I've gone over the zlist API and redesigned it according to some ideas we had last month (partly for the zring class). I tried this out on zlist to see how the ideas would fit but the idea would be to change all the classes where appropriate so they behave the same. Preparing for that I

Re: [zeromq-dev] Proposal for a revised zlist API

2014-09-04 Thread Goswin von Brederlow
On Thu, Sep 04, 2014 at 04:59:19PM +0200, Goswin von Brederlow wrote: Hi, I've gone over the zlist API and redesigned it according to some ideas we had last month (partly for the zring class). I tried this out on zlist to see how the ideas would fit but the idea would be to change all

Re: [zeromq-dev] CZMQ: why aren't zframes reference counted?

2014-09-03 Thread Goswin von Brederlow
queuing and acking, so you can design your own ref counted class on top of zframe. I'd probably not even use zframe then, use zmq_msg directly. On Mon, Sep 1, 2014 at 5:11 PM, Goswin von Brederlow goswin-...@web.de wrote: The zmsg_send_keep() would be using ZFRAME_REUSE. I considered

Re: [zeromq-dev] Ideas for a zfork class

2014-09-03 Thread Goswin von Brederlow
On Tue, Sep 02, 2014 at 05:54:47PM -0300, Rodrigo Mosconi wrote: On Tue, Sep 2, 2014 at 2:42 PM, Pieter Hintjens p...@imatix.com wrote: Also, Zyre now supports IPC and inproc between nodes, if you use the gossip discovery feature. One of my goals eventually is to allow actors to start

Re: [zeromq-dev] Ideas for a zfork class

2014-09-03 Thread Goswin von Brederlow
On Tue, Sep 02, 2014 at 10:32:21AM -0400, Chad Koski wrote: Hi Rodrigo, You might take a look at zyre (https://github.com/zeromq/zyre) to see what you can apply from there before adding a new class. It might save you some work. zyre can handle the discovery, identification, heart beating

Re: [zeromq-dev] How to disconnect a peer?

2014-09-01 Thread Goswin von Brederlow
. Secondly, treat an out-of-order message as an error so that the client side can re-initialize itself correctly. As example, see FILEMQ. On Thu, Aug 28, 2014 at 5:33 PM, Goswin von Brederlow goswin-...@web.de wrote: How do I disconnect a single peer from a ROUTER socket? The closest in the API

[zeromq-dev] router probing not probing when reconnecting

2014-09-01 Thread Goswin von Brederlow
Hi, to me it looks like the probe router socket option only probes on the initial connect but not when reconnecting. I have a server and client process. The client calls (czmq code): zsocket_set_probe_router(zsock_resolve(self.sock), 1); After that the server receives a message containing

[zeromq-dev] CZMQ: why aren't zframes reference counted?

2014-09-01 Thread Goswin von Brederlow
Hi, the zframe_t type is based on the zmq_msg_t type. But while zms_msg_t uses reference counting there is no function to clone a zframe_t using a shared zmq_msg_t object. Consequently there is no way to make a shallow copy of a zmsg_t (which holds a zlist of zframe_t). Also sending a zmsg_t is

Re: [zeromq-dev] Erlang style messaging

2014-08-29 Thread Goswin von Brederlow
On Thu, Aug 28, 2014 at 08:58:49AM -0600, Steve Murphy wrote: Pieter-- Last year, I read the book, Programming Erlang, by Joe Armstrong, and I was fascinated by the ideology behind the general thread-per-object approach, where each object is managed by its own thread, via message passing.

Re: [zeromq-dev] First draft for PPPP rfc (paranoid pirate publish protocol)

2014-08-28 Thread Goswin von Brederlow
On Thu, Aug 28, 2014 at 06:40:10AM -0400, André Caron wrote: Interesting spec :-) The one thing I might be concerned about is the high volume of bandwidth required by ACK messages. The're a section in the guide that does a quick computation of the bandwith requirements for heartbeating and

[zeromq-dev] How to disconnect a peer?

2014-08-28 Thread Goswin von Brederlow
Hi, I've been thinking of error scenarios for my protocol and one of the cases is a peer connecting to the server and becoming unresponsive. This could be accidental or a malicious peer. So what happens in that case? - zmq puts messages into the kernel buffers - zmq puts messages into the

Re: [zeromq-dev] An extension to CZMQ for ephemeral ports

2014-08-25 Thread Goswin von Brederlow
On Mon, Aug 25, 2014 at 12:10:04AM -0600, Steve Murphy wrote: HUH? WHY did you do this? WHY the HECK would this be useful? Here is another good reason: The service might have to be reachable through a firewall, which means adding port forwarding for a range of sockets. You don't want too large

[zeromq-dev] First draft for PPPP rfc (paranoid pirate publish protocol)

2014-08-25 Thread Goswin von Brederlow
Hi, I've written up a first draft for my protocol: implements a reliable two-way dialog between peers. covers presence, heartbeating, request-reply processing and ACKing of messages. It was based loosly on the Paranoid Pirate Protocol. The goals of are to: * Allow peers to

Re: [zeromq-dev] Using zmq sockets from multiple threads

2014-08-22 Thread Goswin von Brederlow
On Thu, Aug 21, 2014 at 10:59:14AM -0400, Peter Durkan wrote: Thanks Charles. On Thu, Aug 21, 2014 at 10:57 AM, Charles Remes li...@chuckremes.com wrote: Yes. http://zeromq.org/area:faq cr On Aug 21, 2014, at 9:53 AM, Peter Durkan pdur...@lucerahq.com wrote: Hi,

Re: [zeromq-dev] Query on zmq_poll API

2014-08-19 Thread Goswin von Brederlow
On Mon, Aug 18, 2014 at 05:14:19PM -0700, Badhrinath Manoharan wrote: Hi, I have the following topology Client --- Broker Server Both the client and server are sockets of type ZMQ_REQ while the Broker has a socket connected to client and another Socket Connected to Server both are

Re: [zeromq-dev] need to lower memory usage

2014-08-18 Thread Goswin von Brederlow
On Fri, Aug 01, 2014 at 11:23:24AM -0700, Dave Peacock wrote: Have just run into this same issue. I haven't tried uclibc yet, tho thanks for that suggestion, will investigate later. For those of you running embedded linux or similar, under posix it looks like there are a few options for

Re: [zeromq-dev] Edge-triggered polling vs Level-triggered. Which one ZMQ is using? Why?

2014-08-18 Thread Goswin von Brederlow
On Fri, Aug 15, 2014 at 01:22:53PM +0300, artemv.zmq wrote: hi Goswin You mentioned: With a level trigger you can poll() and then consume one message from every socket that has input available. Rince and repeat. No socket can starve any other. Why polling every time and do

Re: [zeromq-dev] zeromq, abort(), and high reliability environments

2014-08-14 Thread Goswin von Brederlow
On Wed, Aug 13, 2014 at 09:35:18AM +1000, Michi Henning wrote: My current view on what constitutes a sane API and behavior from the library is heavily driven by what I want, as a user. That is, my C libraries are things I primarily make to use, not to sell. I think it's been about 30 years

Re: [zeromq-dev] zeromq, abort(), and high reliability environments

2014-08-14 Thread Goswin von Brederlow
On Wed, Aug 13, 2014 at 08:37:36AM +0200, Pieter Hintjens wrote: In our APIs we've stripped down error reporting to a minimum. libzmq with its POSIX tendencies still relies IMO far too heavily on subtle error returns (errno == EAGAIN vs. errno == EINVAL?). In higher level language bindings

Re: [zeromq-dev] zeromq, abort(), and high reliability environments

2014-08-14 Thread Goswin von Brederlow
On Wed, Aug 13, 2014 at 09:39:24AM -0500, Thomas Rodgers wrote: For the other cases where the assert happens in a background thread, I could see retrying before giving up in the event of transient errors, but there's still the fundamental complication of how you communicate the now

[zeromq-dev] How do I derive a zactor in CZMQ?

2014-08-14 Thread Goswin von Brederlow
Hi, I'm not sure how zactor in CZMQ is to be used when extending it and following the coding style in CZMQ. The problem is that czmq seems to mix the is a and has a relationships. - Messages can be send/recv from a zmq socket. - A zsock is a struct containing a magic and a zmq socket (has a

Re: [zeromq-dev] zeromq, abort(), and high reliability environments

2014-08-11 Thread Goswin von Brederlow
On Mon, Aug 11, 2014 at 07:52:02AM +0100, Gerry Steele wrote: How about not sending an ack to your users until the unit of work they input has cleared the pipeline? That way the input application can decide what to do. Obviously depends on your application... What if the input application gets

Re: [zeromq-dev] get socket condition

2014-08-11 Thread Goswin von Brederlow
On Mon, Aug 11, 2014 at 05:10:11PM +0800, bino oetomo wrote: Dear all ... Let's say I (using python) have simple : ctx = zmq.Context() socket=ctx.socket(zmq.PUSH) socket.setsockopt(zmq.SNDHWM, 10) socket.connect('tcp://127.0.0.1:9001') I knew that when HWM reach, I'll get EAGAIN

Re: [zeromq-dev] get socket condition

2014-08-11 Thread Goswin von Brederlow
On Mon, Aug 11, 2014 at 05:47:14PM +0800, bino oetomo wrote: Dear All, c/q Goswin von Brederlow .. Really appreciate your response On Mon, August 11, 2014 5:36 pm, Goswin von Brederlow wrote: There are lots of ways the underlying tcp socket can die. But zeromq will reconnect the socket

Re: [zeromq-dev] zeromq, abort(), and high reliability environments

2014-08-11 Thread Goswin von Brederlow
On Mon, Aug 11, 2014 at 04:14:19PM +0200, Pieter Hintjens wrote: On Mon, Aug 11, 2014 at 11:33 AM, Goswin von Brederlow goswin-...@web.de wrote: My suggestion is that if you find an assertion that gets triggered then patch it out and handle the error properly and send a pull request

[zeromq-dev] forwarding a message with metadata

2014-08-11 Thread Goswin von Brederlow
Hi, I hope you don't mind but I want to brainstorm a bit. I want a generic solution to handle heartbeats that I can reuse in different applications. The most transparent way for this seems to be to create a seperate thread for it. So the design looks something like this: [client] PAIR

Re: [zeromq-dev] zeromq, abort(), and high reliability environments

2014-08-11 Thread Goswin von Brederlow
On Mon, Aug 11, 2014 at 04:37:18PM +0200, Goswin von Brederlow wrote: On Mon, Aug 11, 2014 at 04:14:19PM +0200, Pieter Hintjens wrote: On Mon, Aug 11, 2014 at 11:33 AM, Goswin von Brederlow goswin-...@web.de wrote: My suggestion is that if you find an assertion that gets triggered

Re: [zeromq-dev] Edge-triggered polling vs Level-triggered. Which one ZMQ is using? Why?

2014-08-07 Thread Goswin von Brederlow
On Wed, Jul 30, 2014 at 12:32:03PM -0700, Michel Pelletier wrote: On Mon, Jul 21, 2014 at 11:23 AM, Goswin von Brederlow goswin-...@web.de wrote: On Mon, Jul 14, 2014 at 08:42:14AM -0700, Michel Pelletier wrote: I think it is a big issue. On read a level trigger is better because

Re: [zeromq-dev] Can't run tests concurrently due to hardcoded port numbers

2014-07-29 Thread Goswin von Brederlow
On Thu, Jul 24, 2014 at 02:27:41PM -0400, Greg Ward wrote: On 22 July 2014, Pieter Hintjens said: Good catch. We could definitely use ephemeral ports (libzmq supports that), though it would take changes to most of the test cases. OK, I'll open a bug. I'll see about starting on a patch too.

Re: [zeromq-dev] pub/sub and multicast

2014-07-29 Thread Goswin von Brederlow
On Wed, Jul 23, 2014 at 08:45:37PM +, McMillan, Scott A wrote: Hi, Sorry for the very basic question, I'm new to zeromq. The FAQ (http://zeromq.org/area:faq#toc0) says PUB does multicast. How should I interpret this statement? Does this mean that IP-level multicast is required to

Re: [zeromq-dev] Looking for the best server/client layout

2014-07-29 Thread Goswin von Brederlow
On Thu, Jul 24, 2014 at 02:44:31PM -0400, Greg Ward wrote: On 24 July 2014, Mike Zupan said: I'm new to zeromq on the dev side and looking for the best layout to use for a server/client setup where the server can send commands to clients and also the clients can send data back to the server

Re: [zeromq-dev] Multiple clients with REQ/REP

2014-07-29 Thread Goswin von Brederlow
On Thu, Jul 24, 2014 at 08:30:40PM -0500, Gregg Jensen wrote: I currently using zeromq 3.2.3 and will be upgrading to the latest soon, but for now my question relates to this older version. I have been use the REQ/REP socket types for single client to single server with great success. And

Re: [zeromq-dev] Router-Dealer Example not working in C on 4.0.4 ZMQ release

2014-07-29 Thread Goswin von Brederlow
On Wed, Jul 23, 2014 at 12:50:37PM -0700, Badhrinath Manoharan wrote: Hi Peter, Thanks a lot for your response. I was able to try the same as what you had mentioned. I used the raw Zeromq APIs instead of the C binds. Below is my code and the result that I get when. I still don't see them

Re: [zeromq-dev] queue overhead

2014-07-29 Thread Goswin von Brederlow
On Sun, Jul 27, 2014 at 11:13:31AM -0700, Justin Karneges wrote: I have a stable (in the addressing sense) worker that I want to take advantage of multiple cores. So, I run N instances of this worker, where N is the number of cores on the host machine, and each worker binds to its own

Re: [zeromq-dev] Question about ROUTER queue (what if client dies)

2014-07-29 Thread Goswin von Brederlow
On Mon, Jul 28, 2014 at 02:42:50PM +0100, Pedro Januário wrote: hi Peter, I didn???t write C code for a while, but would be something like this: #include czmq.h int main (void) {  zsock_t *router = zsock_new_router (tcp://127.0.0.1:9990);  zsock_t *dealer = zsock_new_dealer

Re: [zeromq-dev] Dissecting Message Queues by Tyler Treat

2014-07-21 Thread Goswin von Brederlow
On Fri, Jul 11, 2014 at 12:47:42PM -0400, Steven McCoy wrote: I don't think I saw this posted yet: noted on highscalability.com today, http://www.bravenewgeek.com/dissecting-message-queues/ -- Steve-o Sending messages to PUB is a lot faster than receiving from SUB according to that post,

Re: [zeromq-dev] Edge-triggered polling vs Level-triggered. Which one ZMQ is using? Why?

2014-07-21 Thread Goswin von Brederlow
On Mon, Jul 14, 2014 at 08:42:14AM -0700, Michel Pelletier wrote: There are some discussions here: http://lwn.net/Articles/25137/ http://www.kegel.com/c10k.html A quick scan of nanomsg source indicates it can use epoll, kqueue, or poll. The first two are edge-triggered and the third is

Re: [zeromq-dev] Extending zmq_msg_t API

2014-07-11 Thread Goswin von Brederlow
). So the only API surface area change is an additional message property. This seems the cleanest to me. On Wednesday, July 9, 2014, Goswin von Brederlow goswin-...@web.de wrote: On Tue, Jul 08, 2014 at 10:42:41AM -0500, Thomas Rodgers wrote: tl;dr; Is there any objection to adding

Re: [zeromq-dev] Curve: Potential DoS with error commands ?

2014-07-09 Thread Goswin von Brederlow
, Goswin von Brederlow goswin-...@web.de wrote: On Thu, Jul 03, 2014 at 09:24:59PM +0200, Pieter Hintjens wrote: I guess the error command could be encrypted with the server long term private key, yes. On Thu, Jul 3, 2014 at 8:15 PM, Diego Duclos diego.duc...@palmstonegames.com

Re: [zeromq-dev] Creating a Simple HTTP Server using zmq_msg_send and zmq_send

2014-07-09 Thread Goswin von Brederlow
On Sun, Jul 06, 2014 at 08:03:11PM -0700, Satish wrote: Hello Programmers I am trying to get acquaint using zeromq library and am developing a program provided below on this forum. I want to use zeromq message to retrieve HTTP message and send HTTP response to multiple client. I

Re: [zeromq-dev] Peer ip address ?

2014-07-09 Thread Goswin von Brederlow
On Sun, Jul 06, 2014 at 08:07:17PM -0700, Satish wrote: Hi, Try using getsocketname. The only problem is that some show the zeromq socket descriptor needs to appear/compatible with a normal socket descriptor. Satish On Thursday, 16 January 2014 03:14:35 UTC+11, mraptor wrote:

Re: [zeromq-dev] Extending zmq_msg_t API

2014-07-09 Thread Goswin von Brederlow
On Tue, Jul 08, 2014 at 10:42:41AM -0500, Thomas Rodgers wrote: tl;dr; Is there any objection to adding some sort of accessor to the API to determine if a given zmq_msg_t is_shared()? Background/Rationale: Something I encountered while writing a high level C++ wrapper for zmq_msg_t and

Re: [zeromq-dev] RFC: PPPP - Paranoid Pirate Publishing Protocol

2014-07-09 Thread Goswin von Brederlow
On Thu, Jul 03, 2014 at 11:50:44AM +0200, Pieter Hintjens wrote: On Thu, Jul 3, 2014 at 10:35 AM, Goswin von Brederlow goswin-...@web.de wrote: I can think of 3 ways to implement this (across all socket types): Do we want this across all socket types? For ROUTER, certainly. Right now

Re: [zeromq-dev] RFC: PPPP - Paranoid Pirate Publishing Protocol

2014-07-09 Thread Goswin von Brederlow
On Thu, Jul 03, 2014 at 11:50:44AM +0200, Pieter Hintjens wrote: The simplest backwards compatible solution would be: 1. use a socket option to enable connect/disconnect events 2. deliver these events as messages, on the socket 3. use a message format that is easy to filter, e.g. size=2 4.

Re: [zeromq-dev] Full-Dublex communication, some questions.

2014-07-09 Thread Goswin von Brederlow
On Wed, Jul 09, 2014 at 12:40:55PM +0200, Kurt Degiorgio wrote: Hi, I am looking to implement a system, where the server controls a number of agents and send them processing tasks, the agents will then update the server (asychnrously) of the progess of the task and finally send the

Re: [zeromq-dev] RFC: PPPP - Paranoid Pirate Publishing Protocol

2014-07-03 Thread Goswin von Brederlow
On Wed, Jul 02, 2014 at 06:09:04PM +0200, Pieter Hintjens wrote: I believe it's been mooted before, and ZMQ_STREAM sockets do this, sending null messages to signal when there's a new client connection and/or a disconnected client. On Wed, Jul 2, 2014 at 2:08 PM, Goswin von Brederlow goswin

Re: [zeromq-dev] PUB/SUB question with IPC

2014-07-03 Thread Goswin von Brederlow
On Wed, Jul 02, 2014 at 10:01:18PM +0200, Pieter Hintjens wrote: The queue will fill up in the background. On Wed, Jul 2, 2014 at 9:33 PM, Martin Townsend martin.towns...@xsilon.com wrote: Hi Pieter, Thanks for the swift reply. I'll give it a go. Another quick question, the process

Re: [zeromq-dev] RFC: PPPP - Paranoid Pirate Publishing Protocol

2014-07-02 Thread Goswin von Brederlow
On Tue, Jul 01, 2014 at 06:23:41PM +0200, Pieter Hintjens wrote: On Tue, Jul 1, 2014 at 4:46 PM, Goswin von Brederlow goswin-...@web.de wrote: 1) with ROUTER/DEALER I don't get a message when a subscriber disconnects without unsubscribing. Eventualy the heartbeat will get

Re: [zeromq-dev] Speed of Subscriptions

2014-07-02 Thread Goswin von Brederlow
On Tue, Jul 01, 2014 at 09:44:49PM -0500, Charles Remes wrote: Should take less than a second assuming a LAN or other low-latency network. cr On Jul 1, 2014, at 3:32 PM, Johnny Lee j...@peaceatwork.org wrote: Hello, I have a question about how fast an average workstation can

Re: [zeromq-dev] RFC: PPPP - Paranoid Pirate Publishing Protocol

2014-07-01 Thread Goswin von Brederlow
On Mon, Jun 30, 2014 at 05:12:08PM +0200, Pieter Hintjens wrote: CURVE works over all socket types, when using TCP or IPC (not when using PGM). On Mon, Jun 30, 2014 at 3:48 PM, Goswin von Brederlow goswin-...@web.de wrote: Hi, I came up with an extension to the Paranoid Pirate Protocol

[zeromq-dev] RFC: PPPP - Paranoid Pirate Publishing Protocol

2014-06-30 Thread Goswin von Brederlow
* Editor: Goswin von Brederlow goswin-...@web.de License === Copyright (c) 2011 iMatix Corporation. Copyright (c) 2014 Goswin von Brederlow goswin-...@web.de This Specification is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License

Re: [zeromq-dev] REQ to many REP.

2014-06-26 Thread Goswin von Brederlow
On Mon, Jun 23, 2014 at 09:24:56PM +0100, Riskybiz wrote: I'd like to set up a 0MQ REQ-REP arrangement where there are many REP sockets connected to just one REQ socket. The actual number of REP sockets is unknown at design-time; however at run-time a list of the port addresses will be

Re: [zeromq-dev] ZMQ_STREAM does not receive 16KB but only 8KB, possible information disclosure

2014-06-26 Thread Goswin von Brederlow
On Tue, Jun 24, 2014 at 02:25:48PM +0200, Mathias Hablützel wrote: Hi everyone, I ran into the issue that sending more than 8KB of data with ZMQ_STREAM (yeah I know, zmq is not intended for that ??? anyway) that on the receiver side it gets truncated. PoC

Re: [zeromq-dev] API changes from 4.0 to 4.1

2014-06-26 Thread Goswin von Brederlow
On Mon, Jun 23, 2014 at 08:06:30PM +0200, Peter Kleiweg wrote: Pieter Hintjens schreef op de 23e dag van de zomermaand van het jaar 2014: On Fri, Jun 20, 2014 at 6:44 PM, Peter Kleiweg pklei...@xs4all.nl wrote: A socket connect for these two addresses return no error. With version

Re: [zeromq-dev] Timeout issue with concurrent send and recv

2014-06-26 Thread Goswin von Brederlow
On Wed, Jun 25, 2014 at 12:56:14PM -0400, br...@openbazaar.org wrote: If I have two servers talking to each other and each listens and send via the same port and they send messages at the same time to each other will this create a race condition? I'm seeing a timeout in this situation with my

Re: [zeromq-dev] Running under valgrind shows a lot of possible data races

2014-06-26 Thread Goswin von Brederlow
On Thu, Jun 26, 2014 at 08:03:08AM +0400, Dmitry Antipov wrote: I've tried to run hwserver and hwclient examples (taken unmodified from zguide) under 'valgrind --tool=helgrind' and see a lot of Possible data race during read of size ... errors (?). Can someone please explain them? Obviously

Re: [zeromq-dev] Running under valgrind shows a lot of possible data races

2014-06-26 Thread Goswin von Brederlow
On Thu, Jun 26, 2014 at 12:03:20PM +0200, Pieter Hintjens wrote: There are various false positives with different valgrind tools. You can maybe catch these in the suppression file? On Thu, Jun 26, 2014 at 10:43 AM, Goswin von Brederlow goswin-...@web.de wrote: On Thu, Jun 26, 2014 at 08:03

Re: [zeromq-dev] auth and metadata in Go (ZeroMQ 4.1.0)

2014-06-26 Thread Goswin von Brederlow
On Thu, Jun 26, 2014 at 11:06:06AM +0200, Peter Kleiweg wrote: I wrote some code in Go to deal with metadata. Here is an example of how to use it: http://godoc.org/github.com/pebbe/zmq4#example-AuthStart This makes the most sense to me. Any suggestions? Note: I prefer

[zeromq-dev] RFH: PUB/SUB + REQ/REP + PPP combo needed

2014-06-26 Thread Goswin von Brederlow
Hi, I'm need a combination of PUB/SUB and REQ/REP with some form of PPP (Paranoid Pirate Protocol) added in the mix and I wonder how to best do this. I have something in mind but I don't want to influecne your thinking. So lets look at it fresh from the outside. Peers: -- - I have a

Re: [zeromq-dev] How to view current SUBs and their filters from PUB side?

2014-06-16 Thread Goswin von Brederlow
No. I mean http://api.zeromq.org/4-0:zmq-socket-monitor MfG Goswin On Thu, Jun 12, 2014 at 04:55:58PM +0800, ? wrote: Hi MfG, Do you mean use zmq_proxy() to monitor inbound messages of a XPUB socket? - Zhichang 2014-06-12 16:06 GMT+08:00 Goswin von Brederlow goswin

Re: [zeromq-dev] on scalability of PUB/SUB and PUSH/PULL

2014-06-12 Thread Goswin von Brederlow
On Wed, Jun 11, 2014 at 02:05:13AM -0700, Jun Li wrote: Hi, I am using PUB/SUB socket pattern to distribute commands from the coordinator to the many worker processes, and I also have the PUSH/PULL to have each worker process to push the processing results to the coordinator. The

Re: [zeromq-dev] How to view current SUBs and their filters from PUB side?

2014-06-12 Thread Goswin von Brederlow
You can get infos through a monitoring socket and through a ZAP handler. MfG Goswin On Thu, Jun 12, 2014 at 10:44:49AM +0800, ? wrote: I'm looking for debug and/or log information. Thanks for your suggestion! - Zhichang 2014-06-12 10:25 GMT+08:00 Michel Pelletier

Re: [zeromq-dev] RFC: finer control of socket type / behaviour

2014-06-05 Thread Goswin von Brederlow
it wouldn't add any new mute state behaviour, just more flexibility which behaviour is used. MfG Goswin On Tue, Jun 3, 2014 at 9:52 AM, Goswin von Brederlow goswin-...@web.de wrote: On Mon, Jun 02, 2014 at 01:11:21PM +0200, Pieter Hintjens wrote: Returning EAGAIN on a full pipe might

  1   2   >