Re: [zeromq-dev] how to hook ZMTP to prepend outputs and trim inputs ?

2014-01-18 Thread Laurent Alebarde
Thanks Pieter for your very informative answer. Have a nice WE, Laurent Le 18/01/2014 08:18, Pieter Hintjens a écrit : TCP is a stream transport, not a message transport. There's no way to know how much data you will receive in any recv() call except to use your own framing (which is why ZMTP

Re: [zeromq-dev] how to hook ZMTP to prepend outputs and trim inputs ?

2014-01-18 Thread Laurent Alebarde
Then out_event / in_event are not used by inproc ? Le 18/01/2014 08:18, Pieter Hintjens a écrit : TCP is a stream transport, not a message transport. There's no way to know how much data you will receive in any recv() call except to use your own framing (which is why ZMTP has a framing

Re: [zeromq-dev] Newbee Question

2014-01-18 Thread Goswin von Brederlow
On Fri, Jan 17, 2014 at 03:18:00PM -0600, Charles Remes wrote: Right now the IPC transport is build on top of UNIX sockets and does not use shared memory. If someone were willing to write and contribute the code to use a shared-memory approach, we would love to have it. The ?roadmap? for

[zeromq-dev] ZHeartbeat

2014-01-18 Thread Mark Marsella
Hi, For a system I am writing I need a ZBeacon like class (runs on a background thread, that has pub sub like interface, sends UDP packets) but instead of broadcast it sends the packets to a list of end points. This will be used to send heartbeats to services a client know about, similar to the

Re: [zeromq-dev] Inter thread communication for scalability

2014-01-18 Thread Goswin von Brederlow
On Fri, Jan 17, 2014 at 05:06:33PM -0600, Kenneth Adam Miller wrote: On Fri, Jan 17, 2014 at 4:35 AM, Goswin von Brederlow goswin-...@web.dewrote: On Thu, Jan 16, 2014 at 09:11:48PM -0600, Kenneth Adam Miller wrote: On Wed, Jan 15, 2014 at 8:36 AM, Goswin von Brederlow goswin-...@web.de

Re: [zeromq-dev] how to hook ZMTP to prepend outputs and trim inputs ?

2014-01-18 Thread Goswin von Brederlow
On Fri, Jan 17, 2014 at 11:40:13AM +0100, Laurent Alebarde wrote: Hi Devs, I am doing some experiments (cf at the end for the goal) and wonder where I could hook the beginning of a message both reading and writing. What I want to do is prepend an outgoing message and trim an incoming

Re: [zeromq-dev] Timing issues

2014-01-18 Thread Andreas Bauer
Sorry, wrong thread. Gesendet:Samstag, 18. Januar 2014 um 08:40 Uhr Von:b...@gmx.net An:ZeroMQ development list zeromq-dev@lists.zeromq.org Betreff:Re: [zeromq-dev] Timing issues If I did it correct (http://pastebin.com/XM9j0HwJ), then Im sending only around 10MB/s, what is virtually

Re: [zeromq-dev] ZHeartbeat

2014-01-18 Thread Pieter Hintjens
Hi Mark, I started on a zservice module with a very similar intention. Perhaps you could expand on that? It's still empty. The notion is to abstract away from the implementation: define a service, look for a service, where the actual mechanics aren't part of the API. zheartbeat is too low level

[zeromq-dev] How should test cases be written?

2014-01-18 Thread Goswin von Brederlow
Hi, having written a patch for connection notification on STREAM sockets I wonder about the test case for stream sockets. Currently there are 3 tests with STREAM sockets (tested in that order): 1) test_stream: (uses recv/send) + test connecting a STREAM and DEALER socket + test connecting

Re: [zeromq-dev] Newbee Question

2014-01-18 Thread Charles Remes
As a matter of fact, we have. On your machine you should run the local_lat/remote_lat and local_thr/remote_thr benchmark programs. You can specify the transport on the command line and measure how fast it is on your box. On Jan 18, 2014, at 3:48 AM, Goswin von Brederlow goswin-...@web.de

Re: [zeromq-dev] how to hook ZMTP to prepend outputs and trim inputs ?

2014-01-18 Thread Laurent Alebarde
Le 18/01/2014 11:58, Goswin von Brederlow a écrit : On Fri, Jan 17, 2014 at 11:40:13AM +0100, Laurent Alebarde wrote: Hi Devs, I am doing some experiments (cf at the end for the goal) and wonder where I could hook the beginning of a message both reading and writing. What I want to do is

Re: [zeromq-dev] ZHeartbeat

2014-01-18 Thread Mark Marsella
Hi Pieter, Yes, the service module sounds more useful and at a better level of abstraction for the library. I will take a look at it. Thanks Mark On 18 January 2014 12:58, Pieter Hintjens p...@imatix.com wrote: Hi Mark, I started on a zservice module with a very similar intention.

Re: [zeromq-dev] Problems with pyczmq.zstr (was Re: pyczmq and ctx.set_linger())

2014-01-18 Thread Michel Pelletier
News On Jan 17, 2014 11:34 PM, Pieter Hintjens p...@imatix.com wrote: Yes, I thought it was cool to make a few of the string functions, like zstr_send, accept printf formats. I've also been bitten more than once by that. Perhaps we can consider this API style to be broken, and dangerous,

[zeromq-dev] News from HCE project

2014-01-18 Thread bgv.hce
Hi, I’m happy to inform the iMatix Corporation staff and especially the developers team that Hierarchical Cluster Engine (HCE) project opened for public access. The network transport engine of HCE that is base of another functional parts is built on ZMQ library and extends PPP implementation

Re: [zeromq-dev] News from HCE project

2014-01-18 Thread crocket
What's your experience in building parallelized application on top of ZeroMQ instead of locking blocks? Can you tell us pros and cons? On Sun, Jan 19, 2014 at 5:06 AM, bgv@gmail.com wrote: Hi, I’m happy to inform the iMatix Corporation staff and especially the developers team that

Re: [zeromq-dev] pyczmq and ctx.set_linger()

2014-01-18 Thread MinRK
On Sat, Jan 18, 2014 at 2:29 AM, Goswin von Brederlow goswin-...@web.dewrote: On Fri, Jan 17, 2014 at 09:34:29AM -0500, Greg Ward wrote: On 17 January 2014, Pieter Hintjens said: On Thu, Jan 16, 2014 at 9:01 PM, Michel Pelletier pelletier.mic...@gmail.com wrote: Yes, pyczmq is