[zeromq-dev] design check question: inproc priority queue

2012-08-26 Thread Michael Haberler
I need an in-process priority queue just two priorities needed: presto and cattle-class consumer shall always process presto messages until presto queue empty, then may continue on cattle-class queue entries. q1: would this setup be the way to go: - two inproc sockets, one for presto, one for

[zeromq-dev] zmq3 'make check' fails on rt-preempt kernel - test_pair_tcp hangs

2012-08-28 Thread Michael Haberler
I'm trying zmq2 and zmq3 on a 2.6.33.7.2-rt30-1-686-bigmem kernel (RT_PREEMPT patch), else ubuntu 10.04 LTS. zmq2: commit 9b07de280107b3b1422e96e90402b7f2a60cf697 zmq3: commit 3aaf1eb1523ffe53708f110ef72a1ed2ddc99ca5 zmq2: make check: All 9 tests passed zmq3: make check: hangs in test_pair_tcp

Re: [zeromq-dev] zmq3 'make check' fails on rt-preempt kernel - test_pair_tcp hangs

2012-08-28 Thread Michael Haberler
Am 28.08.2012 um 11:57 schrieb Michael Haberler: I'm trying zmq2 and zmq3 on a 2.6.33.7.2-rt30-1-686-bigmem kernel (RT_PREEMPT patch), else ubuntu 10.04 LTS. zmq2: commit 9b07de280107b3b1422e96e90402b7f2a60cf697 zmq3: commit 3aaf1eb1523ffe53708f110ef72a1ed2ddc99ca5 zmq2: make check

Re: [zeromq-dev] zmq3 'make check' fails on rt-preempt kernel - test_pair_tcp hangs

2012-08-29 Thread Michael Haberler
Am 29.08.2012 um 22:54 schrieb Ian Barber: On Tue, Aug 28, 2012 at 2:16 PM, Ian Barber ian.bar...@gmail.com wrote: Ah, I fixed a similar issue in master the other day, may well be the same thing. I'll check and send a pull req when I get home. Ian That's all merged in now by the way, so

Re: [zeromq-dev] zmq3 'make check' fails on rt-preempt kernel - test_pair_tcp hangs

2012-08-30 Thread Michael Haberler
Am 30.08.2012 um 15:50 schrieb Ian Barber: On Thu, Aug 30, 2012 at 5:16 AM, Michael Haberler mai...@mah.priv.at wrote: test_shutdown_stress running... /bin/bash: line 5: 23543 Segmentation fault ${dir}$tst FAIL: test_shutdown_stress if I change test_shutdown_stress to start

[zeromq-dev] documenting message flows between several parties as message sequence diagrams

2012-09-08 Thread Michael Haberler
just a note on documenting flows - the zguide is very good anyway in a different project I found it convenient to explain interactions between several entities over time with the help of Message Sequence Charts there is a little-known utility 'mscgen' which translates an MSC diagram in text

Re: [zeromq-dev] Pull request to retire devices and replace with proxies

2012-09-09 Thread Michael Haberler
Am 09.09.2012 um 04:26 schrieb Pieter Hintjens: On Sun, Sep 9, 2012 at 1:59 AM, Garrett Smith g...@rre.tt wrote: I always read device as a higher level interface that's so fundamental it's provided as a reusable black box. Not just a fundamental black box but three special kinds of black

[zeromq-dev] epgm: PUB and SUB sockets on same host cant communicate

2012-09-10 Thread Michael Haberler
I have epgm publisher subscriber working just fine - as long as they run on different hosts both on the same host with say 'epgm://eth0;239.192.1.1:5556' are unable to communicate, regardless of using bind() or connect() on the subscriber side is this a known restriction? any workarounds?

Re: [zeromq-dev] epgm: PUB and SUB sockets on same host cant communicate

2012-09-10 Thread Michael Haberler
Am 10.09.2012 um 17:51 schrieb Steven McCoy: On 10 September 2012 10:26, Michael Haberler mai...@mah.priv.at wrote: I have epgm publisher subscriber working just fine - as long as they run on different hosts both on the same host with say 'epgm://eth0;239.192.1.1:5556' are unable

Re: [zeromq-dev] epgm: PUB and SUB sockets on same host cant communicate

2012-09-10 Thread Michael Haberler
Am 10.09.2012 um 17:51 schrieb Steven McCoy: On 10 September 2012 10:26, Michael Haberler mai...@mah.priv.at wrote: I have epgm publisher subscriber working just fine - as long as they run on different hosts both on the same host with say 'epgm://eth0;239.192.1.1:5556' are unable

Re: [zeromq-dev] documenting message flows between several parties as message sequence diagrams

2012-09-11 Thread Michael Haberler
-m Am 08.09.2012 um 19:05 schrieb Michael Haberler: just a note on documenting flows - the zguide is very good anyway in a different project I found it convenient to explain interactions between several entities over time with the help of Message Sequence Charts there is a little-known

[zeromq-dev] profiling a czmq program with gprof

2012-09-22 Thread Michael Haberler
I tried to profile a program using czmq with gprof which runs fine when compiled with gcc, but without -pg with -pq, the program cops out with: 12-09-22 22:37:24 I: zloop: interrupted (-1) - Interrupted system call any suggestions? - Michael ___

Re: [zeromq-dev] profiling a czmq program with gprof

2012-09-23 Thread Michael Haberler
Am 23.09.2012 um 01:59 schrieb Steven McCoy: On 22 September 2012 16:41, Michael Haberler mai...@mah.priv.at wrote: I tried to profile a program using czmq with gprof which runs fine when compiled with gcc, but without -pg with -pq, the program cops out with: 12-09-22 22:37:24 I: zloop

Re: [zeromq-dev] zmq_poll versus zloop reactor: different semantics - how to resolve?

2012-09-25 Thread Michael Haberler
the prototype with libzmq - which worked fine' which in reality wasnt the case. Am 24.09.2012 um 21:41 schrieb Pieter Hintjens: On Mon, Sep 24, 2012 at 2:00 PM, Michael Haberler mai...@mah.priv.at wrote: I have an application where a named pipe, and a sysfs device is monitored. I did

Re: [zeromq-dev] zmq_poll versus zloop reactor: different semantics - how to resolve?

2012-09-25 Thread Michael Haberler
and czmq can detect and support OOB data on a file descriptor with zloop() as well as zmq_poll(), and deal with sysfs notifications and named pipes properly. - Michael Am 25.09.2012 um 12:36 schrieb Michael Haberler: I am heading towards a solution, but it involves more than just

Re: [zeromq-dev] zmq_poll versus zloop reactor: different semantics - SOLVED; patch available

2012-09-26 Thread Michael Haberler
I've come around to a minimal patch to czmq. Patch and demo program for monitoring a sysfs device (pre post patch) is included: http://git.mah.priv.at/gitweb/czmq.git/shortlog/refs/heads/pollerr-no-disable - Michael Am 24.09.2012 um 21:00 schrieb Michael Haberler: I have an application

Re: [zeromq-dev] zmq_poll versus zloop reactor: different semantics - how to resolve?

2012-09-27 Thread Michael Haberler
Am 27.09.2012 um 19:11 schrieb Pieter Hintjens: On Tue, Sep 25, 2012 at 3:51 PM, Michael Haberler mai...@mah.priv.at wrote: In summary, this would mean that libzmq and czmq can detect and support OOB data on a file descriptor with zloop() as well as zmq_poll(), and deal with sysfs

Re: [zeromq-dev] zmq_poll versus zloop reactor: different semantics - how to resolve?

2012-09-27 Thread Michael Haberler
Am 27.09.2012 um 22:23 schrieb Michael Haberler: ... I think I'll drop named pipes and sysfs, and settle for generic netlink sockets; they work fine with zloop and kernel modules so far and they can be used with uniform adressing kernel/userland as well as user/user which helps

[zeromq-dev] description of REQ/REP state machine?

2012-10-02 Thread Michael Haberler
I'd need a concise description of the REQ/REP state machine - which socket may send which message when, and the states a connection goes through is there such a thing or is it reading zeromq/src/{req,rep}.cpp? - Michael ___ zeromq-dev mailing list

Re: [zeromq-dev] description of REQ/REP state machine?

2012-10-02 Thread Michael Haberler
Am 02.10.2012 um 11:39 schrieb Pieter Hintjens: On Tue, Oct 2, 2012 at 11:33 AM, Michael Haberler mai...@mah.priv.at wrote: I'd need a concise description of the REQ/REP state machine - which socket may send which message when, and the states a connection goes through

[zeromq-dev] kzmq - zmq sockets for Linux kernel modules

2012-10-08 Thread Michael Haberler
: - ksocket library: http://ksocket.sourceforge.net/ by song.xian-gu...@hotmail.com sp_encoder, sp_decoder: https://github.com/250bpm/linux-2.6/tree/sp-v2.6.36/net/sp by Martin Sustrik and Martin Lucina Michael Haberler fecit A.D. 2012 Unix domain sockets: I tried Unix

Re: [zeromq-dev] zmq_poll versus zloop reactor: different semantics - SOLVED; patch available

2012-10-08 Thread Michael Haberler
Am 27.09.2012 um 19:12 schrieb Pieter Hintjens: On Wed, Sep 26, 2012 at 7:50 AM, Michael Haberler mai...@mah.priv.at wrote: I've come around to a minimal patch to czmq. Patch and demo program for monitoring a sysfs device (pre post patch) is included: http://git.mah.priv.at/gitweb

[zeromq-dev] zmq with Xenomai userland RT threads, anyone?

2012-11-09 Thread Michael Haberler
I am considering a setup of several threads cooperating through inproc queues one of those threads must be hard-realtime, with the option of using RT_PREEMPT or Xenomai userland threads ; a polling interface to queues from/to the RT thread is good enough, blocking wait is not needed I'd

Re: [zeromq-dev] zmq with Xenomai userland RT threads, anyone?

2012-11-10 Thread Michael Haberler
be the perfect vehicle to use in this case, but I'm unusure how to reuse that code directly. - Michael live from the 'ZMQ Esoteric Usescases Laboratory' Am 09.11.2012 um 12:26 schrieb Michael Haberler: I am considering a setup of several threads cooperating through inproc queues one of those

[zeromq-dev] GTK event loop integration, anybody?

2013-02-08 Thread Michael Haberler
I'm looking to into integrating zmq with a pyGTK (eventually pygobject) application, including event loop integration any pointers to a working example? Python preferred, C/C++ ok thanks in advance, Michael ___ zeromq-dev mailing list

Re: [zeromq-dev] GTK event loop integration, anybody?

2013-02-08 Thread Michael Haberler
Steven, Am 08.02.2013 um 18:39 schrieb Steven McCoy: On 8 February 2013 12:31, Michael Haberler mai...@mah.priv.at wrote: I'm looking to into integrating zmq with a pyGTK (eventually pygobject) application, including event loop integration any pointers to a working example? You can

Re: [zeromq-dev] GTK event loop integration, anybody?

2013-02-08 Thread Michael Haberler
Am 08.02.2013 um 19:10 schrieb Michael Haberler: Steven, Am 08.02.2013 um 18:39 schrieb Steven McCoy: On 8 February 2013 12:31, Michael Haberler mai...@mah.priv.at wrote: I'm looking to into integrating zmq with a pyGTK (eventually pygobject) application, including event loop

[zeromq-dev] Comment on ZRE spec flaw

2013-02-20 Thread Michael Haberler
reading through the ZRE spec http://rfc.zeromq.org/spec:20 I see a fundamental problem of state agreement through the node discovery process as outline there. The problem is with this sentence When a ZRE node receives a beacon from a node that it does not already know about, it SHALL consider

Re: [zeromq-dev] Comment on ZRE spec flaw

2013-02-24 Thread Michael Haberler
Am 21.02.2013 um 10:31 schrieb Bjorn Reese: On 2013-02-20 10:29, Michael Haberler wrote: - a joining node A sends its own node ID, PLUS a list of all node ID's it has already heard (which may be empty at startup) This got me thinking... In the following I am not trying to solve

Re: [zeromq-dev] What C++ bindings to use ?

2013-05-29 Thread Michael Haberler
Am 28.05.2013 um 13:07 schrieb Pieter Hintjens p...@imatix.com: On Tue, May 28, 2013 at 11:18 AM, Laurent Alebarde l.aleba...@free.fr wrote: As I have to start a project from scratch, do you recommend to stick to C and use CZMQ, or to use C++ bindings or Python bindings ? Criteria would be

Re: [zeromq-dev] What C++ bindings to use ?

2013-05-29 Thread Michael Haberler
...@gmail.com wrote: 2013/5/29 Michael Haberler mai...@mah.priv.at: that leaves me guessing which zmq api I should use assuming I switch to C++ for that application: using the CZMQ C API in a C++ program, which calls upon the C++ binding indirected through the C layer strikes me as a bit

Re: [zeromq-dev] ZMQ_FLAT_PULL feature discussion

2013-06-10 Thread Michael Haberler
Daniel, Am 07.06.2013 um 11:53 schrieb Daniel Krikun krikun.dan...@gmail.com: Occasionally, the clients might be faster and few messages get themselves queued on the server queue. However, only the most recent message is of interest as the server does not renders the objects as they were a

Re: [zeromq-dev] Q: socket type/pattern for protocol exchange

2013-06-10 Thread Michael Haberler
Pieter, Am 10.06.2013 um 11:05 schrieb Pieter Hintjens p...@imatix.com: On Mon, Jun 10, 2013 at 9:33 AM, Michael Haberler mai...@mah.priv.at wrote: I am about to implement a protocol between peers; the phases and interactions being roughly: - an negotiation phase (peers exchange options

Re: [zeromq-dev] Topics for ZMTP 3.0

2013-06-11 Thread Michael Haberler
Am 06.06.2013 um 14:09 schrieb Pieter Hintjens p...@imatix.com: Hi all, As you may know we're drafting a new protocol for tcp://. I read this as 'wireformat will change' In the remote case a more radical departure from the existing wireformat is conceivable, I would suggest: - consider

Re: [zeromq-dev] Q: socket type/pattern for protocol exchange

2013-06-11 Thread Michael Haberler
Am 10.06.2013 um 11:05 schrieb Pieter Hintjens p...@imatix.com: On Mon, Jun 10, 2013 at 9:33 AM, Michael Haberler mai...@mah.priv.at wrote: I am about to implement a protocol between peers; the phases and interactions being roughly: - an negotiation phase (peers exchange options

Re: [zeromq-dev] Q: socket type/pattern for protocol exchange

2013-06-12 Thread Michael Haberler
with trouble if you aren't careful, but also can be blazingly fast and reliable if you are I wound up with a socket setup straight from asyncserv.py, one backend thread per peer, works great - Michael - erik On Mon, Jun 10, 2013 at 3:33 AM, Michael Haberler mai...@mah.priv.at wrote: Hi

Re: [zeromq-dev] ZMQ_FLAT_PULL feature discussion

2013-06-24 Thread Michael Haberler
socket as a not-really-interesting-usecase? I would think a multipart message be treated like a single part messsage - the last message wins regardless of multipart or singlepart, and I'd expect them to be retained in entirety - Michael Thanks On Mon, Jun 10, 2013 at 10:43 AM, Michael

[zeromq-dev] non-destructive queue iterator?

2013-08-09 Thread Michael Haberler
I have an application which I'm adapting to use zmq it's unclear how I would replicate the following queue usage: A queue of pending commands is checked periodically for limit violations; however, the queue entries are not consumed any suggestions how to handle that case? thanks, Michael

[zeromq-dev] ZMQ_WEBSOCKET - any work in progress?

2013-08-09 Thread Michael Haberler
Am 27.06.2013 um 20:58 schrieb Pieter Hintjens p...@imatix.com: So ZMQ_STREAM is now a usable socket type for TCP clients and servers, and I've made a test case that shows simple a HTTP ping-pong, in tests/test_stream.cpp. I think it's a great idea! Is anybody planning/working on a similar

Re: [zeromq-dev] pyzmq: using libzmq functions from cython

2013-08-09 Thread Michael Haberler
Tom, Am 09.08.2013 um 20:34 schrieb Tom Farnbauer tom.farnba...@gmail.com: I'm pretty certain that I'm importing zmq first and it loads just fine. Then once I try to import my stuff, it fails and tells me that: ImportError: libzmq.so: cannot open shared object file: No such file or

Re: [zeromq-dev] ZMQ_WEBSOCKET - any work in progress?

2013-08-11 Thread Michael Haberler
Am 11.08.2013 um 02:09 schrieb Justin Karneges jus...@affinix.com: On 08/09/2013 10:50 AM, Michael Haberler wrote: Am 27.06.2013 um 20:58 schrieb Pieter Hintjens p...@imatix.com: So ZMQ_STREAM is now a usable socket type for TCP clients and servers, and I've made a test case that shows

Re: [zeromq-dev] non-destructive queue iterator?

2013-08-13 Thread Michael Haberler
Am 12.08.2013 um 02:36 schrieb Steven McCoy steven.mc...@miru.hk: On 9 August 2013 13:43, Michael Haberler mai...@mah.priv.at wrote: it's unclear how I would replicate the following queue usage: A queue of pending commands is checked periodically for limit violations; however, the queue

Re: [zeromq-dev] ZMQ_FLAT_PULL feature discussion

2013-08-13 Thread Michael Haberler
Daniel, Am 07.06.2013 um 11:53 schrieb Daniel Krikun krikun.dan...@gmail.com: Hi all, I have a setup, where a server does graphics rendering based on client requests, that is, clients send geometric data (position, orientation, etc.) and the server runs in cycles: process incoming messages

Re: [zeromq-dev] ZMQ_FLAT_PULL feature discussion

2013-08-13 Thread Michael Haberler
using ZeroMQ to distribute frames from video streams for processing and for some of my use cases this feature would be of great interest. I'll happily be a test victim of a patch. Brian On Tue, Aug 13, 2013 at 4:27 AM, Michael Haberler mai...@mah.priv.at wrote: Daniel, Am 07.06.2013

Re: [zeromq-dev] ZMQ_FLAT_PULL feature discussion

2013-08-14 Thread Michael Haberler
, not the last one, of the hwm is reached - is that what you suggest works? -m On Tue, Aug 13, 2013 at 6:59 PM, Michael Haberler mai...@mah.priv.at wrote: Am 13.08.2013 um 17:29 schrieb Daniel Krikun krikun.dan...@gmail.com: I have almost finished the feature, in the mean time

Re: [zeromq-dev] ZMQ_WEBSOCKET - any work in progress?

2013-08-21 Thread Michael Haberler
I found a starting point for what I want - libwebsockets/zmq bridging in C++: https://github.com/dsoo/shardfree very early, very c++11ish, but a cheatsheet to start from -Michael Am 11.08.2013 um 14:47 schrieb Michael Haberler mai...@mah.priv.at: Am 11.08.2013 um 02:09 schrieb Justin

[zeromq-dev] nitro

2013-08-23 Thread Michael Haberler
just stumbled over this: http://gonitro.io/ https://github.com/bumptech/nitro curious.. any opinions? - Michael ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] How to send/receive a custom C++ object via zeromq sockets?

2013-09-18 Thread Michael Haberler
Am 18.09.2013 um 04:53 schrieb Michael Scofield bayinam...@gmail.com: I strongly recommend Google's Protocol Buffer as the serialization/deserialization tool. It's fast, convenient and robust. It directly transform an object to the bytes formation(and vice-versa), so can be send/recv

Re: [zeromq-dev] zmq epoll loop taking over 50% of application cpu time

2013-09-30 Thread Michael Haberler
Gabriel, I have written a simple zmq/libwebsockets application (low performance requirements so I didnt try to push things yet) however, I have used Andrew Canaday's libev-based libwebsockets variant: https://github.com/andrew-canaday/libwebsockets (still a bit of a moving target but

[zeromq-dev] XPUB and unsubscribe notification message count (bug or not?)

2013-11-12 Thread Michael Haberler
I'm puzzled by the following behaviour (trying to track subscriber count per topic): XPUB server, XPUB_VERBOSE set server tracks messages received on XPUB socket single client: client 1: SUB socket, connects to server, subscribes to 'topic' - server receives subscribe message (\001topic)

Re: [zeromq-dev] XPUB and unsubscribe notification message count (bug or not?)

2013-11-12 Thread Michael Haberler
. -m Am 12.11.2013 um 20:25 schrieb Michael Haberler mai...@mah.priv.at: I'm puzzled by the following behaviour (trying to track subscriber count per topic): XPUB server, XPUB_VERBOSE set server tracks messages received on XPUB socket single client: client 1: SUB socket, connects

[zeromq-dev] pyzmq - pyczmq rewrite

2013-11-17 Thread Michael Haberler
Hi Michel, just rewrote a protobuf/pyzmq Python application to use pyczmq (because I'm interested in beacon and securitiy support) first - no surprise; great job! just a note on the zframe wrapping: It would be handy to have a wrapping which supports the buffer call interface (such as

Re: [zeromq-dev] pyzmq - pyczmq rewrite

2013-11-18 Thread Michael Haberler
Hi Michel, Am 18.11.2013 um 04:52 schrieb Michel Pelletier pelletier.mic...@gmail.com: This uses ctypes.Structure.from_buffer to copy objects to and from an mmaped file with no serialization, in theory the only serializing happens out of process by the kernel to and from the mapped file.

Re: [zeromq-dev] GTK event loop integration, anybody?

2013-11-19 Thread Michael Haberler
: def zmq_readable(self, eventfd, condition, socket, callback): while zsocket.events(socket) zmq.POLLIN: callback(socket) return True -m Am 08.02.2013 um 20:47 schrieb Michael Haberler mai...@mah.priv.at: Am 08.02.2013 um 19:10 schrieb Michael Haberler: Steven

Re: [zeromq-dev] cancel czmq timers by id

2013-11-20 Thread Michael Haberler
Am 20.11.2013 um 09:58 schrieb Chris Laws clawsi...@gmail.com: Many of my system's (CZMQ based) applications are long running, though some applications within my system come and go. Many applications do various timer based work when certain applications are present and should not be doing

[zeromq-dev] pyczmq: zloop callback arguments?

2013-11-20 Thread Michael Haberler
I'm stuck at passing 'self' as a timer callback argument: Class Test: @ffi.callback('zloop_fn') def timer_event(loop, item, arg): print type(loop), type(item), type(arg) def __init__(self): ... zloop.timer(self.loop, msec, 1, self.timer_event, self) #

Re: [zeromq-dev] pyczmq: zloop callback arguments?

2013-11-20 Thread Michael Haberler
-Michel On Wed, Nov 20, 2013 at 4:09 AM, Michael Haberler mai...@mah.priv.at wrote: I'm stuck at passing 'self' as a timer callback argument: Class Test: @ffi.callback('zloop_fn') def timer_event(loop, item, arg): print type(loop), type(item), type(arg) def

Re: [zeromq-dev] Client-side web applications with ZeroMQ

2013-11-21 Thread Michael Haberler
Am 21.11.2013 um 06:57 schrieb Justin Karneges jus...@affinix.com: There's NullMQ, although I'm not sure of its status: https://github.com/progrium/nullmq In my opinion, all a web application really needs is request/response and pubsub, and you already have request/response in the form of

Re: [zeromq-dev] RFC: zbeacon for dhcp-style discovery

2013-11-27 Thread Michael Haberler
, Nov 27, 2013 at 12:52 PM, Pieter Hintjens p...@imatix.com wrote: The problem with sending a single UDP message is that there's a fair chance of it getting lost. On Wed, Nov 27, 2013 at 12:24 PM, Bjorn Reese bre...@mail1.stofanet.dk wrote: On 11/27/2013 12:03 PM, Michael Haberler wrote

Re: [zeromq-dev] RFC: zbeacon for dhcp-style discovery

2013-11-27 Thread Michael Haberler
Am 27.11.2013 um 14:15 schrieb Arnaud Loonstra arn...@sphaero.org: On 11/27/2013 12:03 PM, Michael Haberler wrote: I consider using zbeacon for service discovery, but more in a DHCP-style way (I dont have the use case for permanently visible beacons since the information is used during

Re: [zeromq-dev] Poll on sockets OR child process

2013-11-27 Thread Michael Haberler
Am 27.11.2013 um 20:23 schrieb Greg Ward g...@gerg.ca: Hi all -- I'm hacking on a task distribution system used internally here. It has N masters sending tasks (shell commands) out to M workers, and then doing stuff with the results. There's something that annoys me slightly about the

Re: [zeromq-dev] Poll on sockets OR child process

2013-11-27 Thread Michael Haberler
Am 28.11.2013 um 01:58 schrieb Greg Ward g...@gerg.ca: On 27 November 2013, Michael Haberler said: Is there any sane way to do this? (The whole system is written in Python, using zeromq-3.2.3 and pyzmq 13.1.0.) maybe you'd want to use SIGCHLD Hey, 20 years with Unix and I'm still

Re: [zeromq-dev] RFC: zbeacon for dhcp-style discovery

2013-11-30 Thread Michael Haberler
I have a seemingly trivial problem where I currently have tunnel vision: if I send a directed UDP packet to the beacon socket, the s_beacon_recv () callback isnt called except if I force the destination address to broadcast (255.255.255.255; in which case tcpdump does display the packet) if I

Re: [zeromq-dev] RFC: zbeacon for dhcp-style discovery

2013-12-12 Thread Michael Haberler
/30/2013 06:30 PM, Michael Haberler wrote: Hi Arnaud, Am 30.11.2013 um 17:16 schrieb Arnaud Loonstra arn...@sphaero.org: On 11/30/2013 03:49 PM, Michael Haberler wrote: I have a seemingly trivial problem where I currently have tunnel vision: if I send a directed UDP packet to the beacon

[zeromq-dev] czmq/zbeacon: unicast UDP support, pyczmq bindings available

2013-12-16 Thread Michael Haberler
czmq: this branch adds two new methods to zbeacon: https://github.com/mhaberler/czmq/commits/zbeacon-unicast // Start/stop listening on unicast packets void zbeacon_unicast (zbeacon_t *self, int flag) // Send a frame directed to a particular IP unicast address once void zbeacon_send

Re: [zeromq-dev] Poll on sockets OR child process

2013-12-20 Thread Michael Haberler
Am 20.12.2013 um 00:56 schrieb Michel Pelletier pelletier.mic...@gmail.com: So in (pyczmq) code I was thinking something like: @zloop.signal_callback def on_signal_event(loop, item, arg): ... loop = zloop.new() zloop.signal(loop, signal.SIGHUP, on_signal_event) the issue I see:

Re: [zeromq-dev] Poll on sockets OR child process

2013-12-22 Thread Michael Haberler
Michel, Am 22.12.2013 um 02:58 schrieb Michel Pelletier pelletier.mic...@gmail.com: On Fri, Dec 20, 2013 at 1:06 AM, Michael Haberler mai...@mah.priv.at wrote: Am 20.12.2013 um 00:56 schrieb Michel Pelletier pelletier.mic...@gmail.com: So in (pyczmq) code I was thinking something like

Re: [zeromq-dev] Poll on sockets OR child process

2013-12-23 Thread Michael Haberler
Am 22.12.2013 um 20:33 schrieb Michel Pelletier pelletier.mic...@gmail.com: On Sun, Dec 22, 2013 at 12:25 AM, Michael Haberler mai...@mah.priv.at wrote: Michel, Am 22.12.2013 um 02:58 schrieb Michel Pelletier pelletier.mic...@gmail.com: On Fri, Dec 20, 2013 at 1:06 AM, Michael

Re: [zeromq-dev] zbeacon changes

2013-12-23 Thread Michael Haberler
Am 23.12.2013 um 13:53 schrieb Pieter Hintjens p...@imatix.com: Michael, I've been hacking on zbeacon and removed most of your new code (the unicast/send methods). The main reason is I don't think they belong there at all, and turns the zbeacon concept into a UDP stuff happens here class,

Re: [zeromq-dev] Poll on sockets OR child process

2013-12-24 Thread Michael Haberler
Am 23.12.2013 um 23:58 schrieb Michel Pelletier pelletier.mic...@gmail.com: btw this Python wrapping works fine for me doing beacon unicast reception/sending for DHCP-style discovery: https://github.com/mhaberler/pyczmq/commits/zbeacon-unicast I forgot to mention, this PR is against

[zeromq-dev] service discovery - problem description (was: Re: Poll on sockets OR child process)

2013-12-25 Thread Michael Haberler
' solution; there is no need for permanent broadcasting of service descriptions ala zbeacon. - Michael Am 25.12.2013 um 10:41 schrieb Pieter Hintjens p...@imatix.com: On Tue, Dec 24, 2013 at 4:21 PM, Michael Haberler mai...@mah.priv.at wrote: no, let's have that sit a while until Pieter's

Re: [zeromq-dev] service discovery - problem description (was: Re: Poll on sockets OR child process)

2013-12-27 Thread Michael Haberler
Am 25.12.2013 um 14:16 schrieb Pieter Hintjens p...@imatix.com: On Wed, Dec 25, 2013 at 1:44 PM, Michael Haberler mai...@mah.priv.at wrote: rationale for the UDP unicast send/receive pattern: my application scenario: This suggests a 'query broadcast', followed by 'reply unicast' sequence

[zeromq-dev] inproc bind/connect order and GET_FD/EVENTS

2014-01-06 Thread Michael Haberler
I saw some work being done on inproc sockets being relaxed wrt bind/connect order it seems inproc sockets still have an issue when the GET_FD/EVENTS scheme is used. inproc: connect then bind - works inproc: bind then connect - no events delivered on GET_FD fd all other variations I tried

[zeromq-dev] gist: using signalfd with zloop - synchronous signal delivery

2014-01-14 Thread Michael Haberler
since it's a bit tricky (or rather I didnt get it right first time..): here is an example for using signalfd(2) for synchronous signal delivery in a zloop reactor the key steps are: - disable czmq signal handling by zsys_handler_set() once the context is created; this will also disable setting

Re: [zeromq-dev] FOSDEM'14

2014-01-28 Thread Michael Haberler
Am 28.01.2014 um 11:45 schrieb Łukasz Nowak em...@lnowak.com: Hello, I'd be happy to have a HBM (High Beer Mark) in nonblocking messaging spirit. Is Friday evening ok to anyone? coming saturday morning, leaving sunday evening - so Saturday would be my preference - Michael Lukasz

Re: [zeromq-dev] TPubSub pattern

2014-01-28 Thread Michael Haberler
Am 28.01.2014 um 09:45 schrieb Doron Somech somdo...@gmail.com: Thanks Pieter, NetMQ doesn't have authentication yet, but once authentication is in place the token is not needed (and the credentials can be retrieved per message). What is do needed for me at least is a way for the

[zeromq-dev] making inproc into transproc

2014-01-29 Thread Michael Haberler
I understand the inproc sockets are dead-fast but inproc-only because the eventfd notification is used, which is compatible with poll(2) eventfd normally is used between threads or processes with common ancestors however, it is possible to pass eventfd file descriptors between arbitrary

Re: [zeromq-dev] making inproc into transproc

2014-02-01 Thread Michael Haberler
Am 01.02.2014 um 13:13 schrieb Goswin von Brederlow goswin-...@web.de: On Wed, Jan 29, 2014 at 10:09:20PM +0100, Michael Haberler wrote: I understand the inproc sockets are dead-fast but inproc-only because the eventfd notification is used, which is compatible with poll(2) eventfd

Re: [zeromq-dev] Idea: Create sockets from existing FD

2014-02-03 Thread Michael Haberler
Am 01.02.2014 um 13:32 schrieb Goswin von Brederlow goswin-...@web.de: Hi, I've been thinking of using zmq for a little daemon. But I also want to support systemd socket activation. Now those two combined make a problem. ZMQ has no way to create a zmq socket given an existing FD. And

Re: [zeromq-dev] [OT] ZMQ + priority queue scheduler ?

2014-02-04 Thread Michael Haberler
Am 04.02.2014 um 11:24 schrieb Floris van Manen v...@klankschap.nl: Hello, As i'm new to this list i'd like to check if there is anyone also involved in discrete time simulation of events. Subscriptions to individual events are handled in parallel at each time point. I'm exploring the

[zeromq-dev] coding note: redirecting libzmq/czmq library logging

2014-02-13 Thread Michael Haberler
the libraries write assertion errors to stderr (eg libzmq/src/err.hpp) or stdout for debugging (e.g. zclock_log()) that's a tad annoying in a daemon setup where you'd want to have that output go to syslog instead of a terminal I found this neat trick, which enables redirection of FILE *

[zeromq-dev] Q: distributed configuration access - recommendations?

2014-02-16 Thread Michael Haberler
I'm retroftting zeroMQ into what used to be an all-on-one-host application; it goes distributed, and some parts are on embedded systems. Still another part would be UI's which could be Gtk, Qt, Java, or JS/websockets. I'm looking for a robust method for distributed configuration data access.

Re: [zeromq-dev] Hole Punching

2014-02-16 Thread Michael Haberler
Am 15.02.2014 um 18:00 schrieb Ngo Doan Lap lapngod...@gmail.com: Hi all, I'm developing P2P application using zeromq. In the real world, some peers are visible to others (they have public IP), some peers are invisible to others as they behind a NAT. The paper Peer-to-Peer Communication

[zeromq-dev] clone pattern Q: ok to replace by XPUB?

2014-02-18 Thread Michael Haberler
The clone pattern is close to what I need for state replication. There's one simplification I plan to use (assuming clone was written before XPUB was around): as per guide, clone uses PUB(server)/SUB(client) for distribution of a subtree, and DEALER(client)/ROUTER(server) for client state

[zeromq-dev] czmq: zloop_poller for stdin - ambiguity

2014-03-13 Thread Michael Haberler
trying to use zloop for reading with libreadline on stdin, while handling other events this doesnt work because fd 0 is considered invalid in zloop.c:328 ; if I disable the check that works just fine I see two ways to resolve the situation: - consider a zmq_pollitem with socket=NULL and fd=0

Re: [zeromq-dev] czmq: zloop_poller for stdin - ambiguity

2014-03-13 Thread Michael Haberler
here is the bonus gist conditional on this patch: using libreadline in zloop https://gist.github.com/mhaberler/9537478 - Michael On Thu, Mar 13, 2014 at 9:09 PM, Michael Haberler mai...@mah.priv.at wrote: trying to use zloop for reading with libreadline on stdin, while handling other

Re: [zeromq-dev] czmq: zloop_poller for stdin - ambiguity

2014-03-14 Thread Michael Haberler
PM, Pieter Hintjens p...@imatix.com wrote: I merged your patch, nice. :) I'd never thought of using stdin with ZeroMQ sockets, it's a neat mix. On Thu, Mar 13, 2014 at 10:39 PM, Michael Haberler mai...@mah.priv.at wrote: Am 13.03.2014 um 22:24 schrieb Pieter Hintjens p...@imatix.com

Re: [zeromq-dev] Problem on ARM platform

2014-04-11 Thread Michael Haberler
David, Am 11.04.2014 um 19:26 schrieb David Jagoe davidja...@gmail.com: Ahoy, I've got a simple program that works on my PC but not when I compile it on an ARM platform. In both cases I'm running on Linux (Ubuntu on my PC and Debian Wheezy on the ARM target). In both cases I have

[zeromq-dev] multipart messages in a realtime environment

2014-04-16 Thread Michael Haberler
we're using zeroMQ in machinekit (formerly LinuxCNC) to retain the end-to-end principle, we need to be able to send multipart messages to and from RT threads that isnt possible with libzmq code since it's C++ and uses dynamic memory allocation the code which we'll be using is based on a

Re: [zeromq-dev] multipart messages in a realtime environment

2014-04-17 Thread Michael Haberler
Am 18.04.2014 um 00:33 schrieb Goswin von Brederlow goswin-...@web.de: On Thu, Apr 17, 2014 at 10:54:59PM +0200, Michael Haberler wrote: Goswin, Am 17.04.2014 um 11:24 schrieb Goswin von Brederlow goswin-...@web.de: On Wed, Apr 16, 2014 at 08:07:27PM +0200, Michael Haberler wrote: we're

[zeromq-dev] note on zlog.c syslog_async

2014-05-01 Thread Michael Haberler
I notice zlog.c was added to czmq recently in the machinekit project we used syslog from a cyclic process which at times generates log messages in short succession, but should not block on syslog() we had all sorts of problems with blocking, funny hangs in futex calls and whatnot with syslog

[zeromq-dev] q: how to announce a DSN when using tcp://*:*

2014-05-09 Thread Michael Haberler
I'm using DNS-SD for service discovery, and would like to bind sockets like tcp://*:* - i.e. all interfaces, and choose an ephemeral port it would be nice if the DSN retrieved from the ZMQ_LAST_ENDPOINT could be used for this; however, int the case of tcp://*:* (i.e INADDR_ANY) that comes out

[zeromq-dev] czmq / avahi integration into zloop

2014-05-12 Thread Michael Haberler
I cooked up an avahi event loop adapter for czmq. works for me: https://github.com/mhaberler/avahi-czmq-loop no threads, just using the zloop reactor. - Michael ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org

Re: [zeromq-dev] czmq / avahi integration into zloop

2014-05-13 Thread Michael Haberler
zthread_fork() and its own event loop it's not as general as Björn's aware, but covers the common case for czmq use without introducing another event loop mechanism - Michael On Tue, May 13, 2014 at 12:22 AM, Michael Haberler mai...@mah.priv.at wrote: I cooked up an avahi event loop adapter

Re: [zeromq-dev] q: how to announce a DSN when using tcp://*:*

2014-05-15 Thread Michael Haberler
with that generous offer - try the URI's in turn and see if there's a response? I'd love to see a solution to this with less manual massage of setup - just a support problem in the making thanks! - Michael On Fri, May 9, 2014 at 3:19 PM, Michael Haberler mai...@mah.priv.at wrote: I'm using DNS-SD

Re: [zeromq-dev] note on zlog.c syslog_async

2014-05-24 Thread Michael Haberler
a day or so, I need to add the warning that http://thekelleys.org.uk/syslog-async/READ-ME clearly states that the syslog_async() code 'is not, currently, threadsafe.'. - Michael On Thu, May 1, 2014 at 4:09 PM, Michael Haberler mai...@mah.priv.at wrote: I notice zlog.c was added to czmq

[zeromq-dev] application demo: remote Qt5 QtQuick GUI running over zeromq/protobuf

2014-05-29 Thread Michael Haberler
switching to zeromq is starting to pay off for the machinekit project - we're about to have something to show, after a lengthy effort to revamp the existing LinuxCNC middleware to use zeroMQ and protobuf serialisation one of the deliverables is a generic UI vehicle (Appearance and logic defined

Re: [zeromq-dev] New Projects: NetMQ.WebSockets and JSMQ

2014-06-23 Thread Michael Haberler
Hi Doron, Am 23.06.2014 um 10:25 schrieb Doron Somech somdo...@gmail.com: Hi All, I'd like to introduce two new projects I'm working on: https://github.com/somdoron/JSMQ - ZeroMQ/NetMQ javascript client over WebSockets https://github.com/somdoron/NetMQ.WebSockets - WebSockets extension

Re: [zeromq-dev] New Projects: NetMQ.WebSockets and JSMQ

2014-06-24 Thread Michael Haberler
there. - Michael Regards, Doron On Mon, Jun 23, 2014 at 2:53 PM, Michael Haberler mai...@mah.priv.at wrote: Hi Doron, Am 23.06.2014 um 10:25 schrieb Doron Somech somdo...@gmail.com: Hi All, I'd like to introduce two new projects I'm working on: https://github.com

Re: [zeromq-dev] New Projects: NetMQ.WebSockets and JSMQ

2014-06-24 Thread Michael Haberler
, delimited with a zero-length frame; the options are either to pass those through via WS as-is, or maybe handle them at proxy proper if that is to be the last zeromq endpoint having a visible identity cheers - Michael Doron On Tue, Jun 24, 2014 at 9:20 AM, Michael Haberler

  1   2   >