[zeromq-dev] pyzmq 14.3.1 test failure

2014-07-29 Thread Greg Ward
Hey folks -- I'm trying to build pyzmq 14.3.1, but getting a couple of test failures. One is intermittent, but the other seems to happen every time (except when the tests crash early because of the intermittent failure). This is on Scientific Linux 6.5, 64-bit Intel, using the OS RPM

Re: [zeromq-dev] Can't run tests concurrently due to hardcoded port numbers

2014-07-24 Thread Greg Ward
On 22 July 2014, Pieter Hintjens said: Good catch. We could definitely use ephemeral ports (libzmq supports that), though it would take changes to most of the test cases. OK, I'll open a bug. I'll see about starting on a patch too. From the zmq_tcp man page: The TCP port number may

Re: [zeromq-dev] pub/sub and multicast

2014-07-24 Thread Greg Ward
On 23 July 2014, McMillan, Scott A said: Hi, Sorry for the very basic question, I'm new to zeromq. The FAQ (http://zeromq.org/area:faq#toc0) says PUB does multicast. How should I interpret this statement? Does this mean that IP-level multicast is required to use the pub/sub pattern?

Re: [zeromq-dev] Looking for the best server/client layout

2014-07-24 Thread Greg Ward
On 24 July 2014, Mike Zupan said: I'm new to zeromq on the dev side and looking for the best layout to use for a server/client setup where the server can send commands to clients and also the clients can send data back to the server without being told to run a command. Pretty much like the

[zeromq-dev] Can't run tests concurrently due to hardcoded port numbers

2014-07-22 Thread Greg Ward
Hi all -- I stumbled across this because our build system (a local instance of OBS) uses chroot environments to build RPMs, with multiple chroots on a single host. If the zeromq 4.0.x tests happen to run concurrently in different chroots on the same host, they fail. You can reproduce this easily

[zeromq-dev] Partially encrypted service

2014-03-31 Thread Greg Ward
Hi all -- I'm helping maintain a ZeroMQ-based system that currently uses a homebrew cryptosystem on top of libzmq 3.2.4. Obviously I'd like to upgrade to curve and libzmq 4. While I'm doing that, I'd like to change it so that only untrusted connections (across the Internet) are subject to

Re: [zeromq-dev] pyzmq curve example code

2014-02-26 Thread Greg Ward
On 25 February 2014, MinRK said: The weird errno should be fixed in masterhttps://github.com/zeromq/pyzmq/pull/483. But this should only affect the case when libzmq is not linked against libsodium. Are you sure that it is? Arggh. You're quite right; I have must have forgotten

Re: [zeromq-dev] zeromq epgm basic testing

2014-02-26 Thread Greg Ward
On 26 February 2014, Jim Chan said: Hi there, I'm really new to zmq multicast and would like to try it out with below very simple code:         void *context = zmq_ctx_new();         void *socket = zmq_socket (context, ZMQ_PUB);         int rc = zmq_bind(socket,

Re: [zeromq-dev] pyzmq curve example code

2014-02-26 Thread Greg Ward
On 26 February 2014, I said: Cannot confirm your fix yet, as I'm battling a CFFI error. In case anyone can throw me a hint, the problem I'm now having is: $ PYTHONPATH=/data/src/pyzmq python generate_certificates.py

Re: [zeromq-dev] pyzmq curve example code

2014-02-26 Thread Greg Ward
On 26 February 2014, To ZeroMQ development list said: On 26 February 2014, I said: Cannot confirm your fix yet, as I'm battling a CFFI error. In case anyone can throw me a hint, the problem I'm now having is: $ PYTHONPATH=/data/src/pyzmq python generate_certificates.py

Re: [zeromq-dev] pyzmq curve example code

2014-02-25 Thread Greg Ward
On 24 February 2014, MinRK said: How did you build libzmq and/or install pyzmq? It could be that you don't have libsodium linked, in which case the curve_keypair would fail. If that's the case, obviously the error message should be better. My original setup from several weeks ago: * git

Re: [zeromq-dev] pyzmq curve example code

2014-02-25 Thread Greg Ward
On 25 February 2014, To ZeroMQ development list said: But that seems to have decayed somewhat. I noticed an error from pyzmq's setup script about libsodium in the umpteenth build yesterday. I think maybe I'll start from scratch with a fresh prefix dir and see if that clarifies things. OK I've

[zeromq-dev] pyzmq curve example code

2014-02-24 Thread Greg Ward
Hey all -- I'm playing around with the security examples in latest master of pyzmq. Looks promising, but not perfect. In particular, I'm stuck by this failure: $ python generate_keys.py Traceback (most recent call last): File generate_keys.py, line 50, in module

[zeromq-dev] Oops! I broke pyczmq

2014-02-03 Thread Greg Ward
175520bd3b2562089148f8bd66c9ebc8720e14b2 Author: Greg Ward g...@gerg.ca Date: Thu Jan 16 17:10:54 2014 -0500 Make import pyczmq faster (backwards incompatible change!). Ooops! The problem is apparently that zauth.py (and several other modules: zbeacon, zcertstore, ...) implicitly

[zeromq-dev] Using pyczmq for zcert/zauth only

2014-02-03 Thread Greg Ward
Hi all -- I'm back to playing around with pyczmq for secure messaging. I'm perfectly happy with the pyzmq interface. In fact, I could happily stick with 0MQ 3.2.x, and ignore CZMQ (and pyczmq) entirely, except for the need for authentication and encryption. A few weeks ago, I successfully

Re: [zeromq-dev] Problems with pyczmq.zstr (was Re: pyczmq and ctx.set_linger())

2014-01-20 Thread Greg Ward
. the Python binding could just ignore zstr_sendf() -- I imagine most Python programmers would reach for Python's string-formatting facilities first. Greg -- Greg Wardhttp://www.gerg.ca g...@gerg.ca @gergdotca

Re: [zeromq-dev] pyczmq and ctx.set_linger()

2014-01-17 Thread Greg Ward
On 17 January 2014, Pieter Hintjens said: On Thu, Jan 16, 2014 at 9:01 PM, Michel Pelletier pelletier.mic...@gmail.com wrote: Yes, pyczmq is very much a literal 1 to 1 wrapper around the czmq C interface. Note that there is also an object oriented interface: CZMQ was designed to

Re: [zeromq-dev] pyczmq and ctx.set_linger()

2014-01-17 Thread Greg Ward
On 17 January 2014, MinRK said: Would it make sense for pyzmq to wrap CZMQ as well? I don't think it would. Most of the things czmq adds to libzmq are more logically reimplemented in Python, rather than exposed by linking anothing library. The added C dependency would also be too much of a

[zeromq-dev] Problems with pyczmq.zstr (was Re: pyczmq and ctx.set_linger())

2014-01-17 Thread Greg Ward
On 17 January 2014, Michel Pelletier said: zstr however is how you turn messages into strings. It is not an implementation of a string type. It is critical to the functionality of pyczmq (assuming you want string output from the library). I was going to start another thread about this... but

[zeromq-dev] pyczmq and ctx.set_linger()

2014-01-16 Thread Greg Ward
Hi all -- after successfully using czmq for the first time yesterday, I'm now trying pyczmq. (Specifically, I'm translating the ironhouse example from Pieter's blog: http://hintjens.com/blog:49.) I got stumped pretty quickly: import pyczmq ctx = pyczmq.zctx.new() ctx.set_linger(1000)

Re: [zeromq-dev] pyczmq and ctx.set_linger()

2014-01-16 Thread Greg Ward
On 16 January 2014, I said: after successfully using czmq for the first time yesterday, I'm now trying pyczmq. (Specifically, I'm translating the ironhouse example from Pieter's blog: http://hintjens.com/blog:49.) I got stumped pretty quickly: import pyczmq ctx = pyczmq.zctx.new()

[zeromq-dev] pyczmq import overhead

2014-01-16 Thread Greg Ward
Speaking of pyczmq, it is *very* slow to import: $ time python -c 'import pyczmq' python -c 'import pyczmq' 1.11s user 0.05s system 100% cpu 1.152 total Turns out this is because pyczmq/__init__.py imports every submodule, as well as some identifiers in a couple of submodules. I'm

Re: [zeromq-dev] libzmq build broken

2014-01-16 Thread Greg Ward
On 16 January 2014, Lindley French said: After pulling down libzmq master at 53d0199e50https://github.com/zeromq/libzmq/commit/53d0199e50ddc9fad07b5cf64113cdbf7a0fbf04, my build on linux breaks: *** No rule to make target `curve_keygen.c', needed by `curve_keygen.o'. Stop. Works fine for

Re: [zeromq-dev] Poll on sockets OR child process

2013-12-18 Thread Greg Ward
-obvious to me, I assume it will be non-obvious to others in future. So I made several working examples and wrote up a blog post: http://gerg.ca/blog/post/2013/zmq-child-process/ Comments/criticisms are welcome. Greg -- Greg Wardhttp://www.gerg.ca g...@gerg.ca

[zeromq-dev] Debugging No route to host when sending over ROUTER

2013-12-17 Thread Greg Ward
Hi all -- I'm working on overhauling the 0MQ layer of an existing app. (It's written in Python, using zeromq 3.2.3 and pyzmq 13.1.0.) The good thing about the existing code is that the entire 0MQ layer is isolated in one Python module. Unfortunately, that module appears to reinvent 0MQ: it does

Re: [zeromq-dev] Debugging No route to host when sending over ROUTER

2013-12-17 Thread Greg Ward
On 17 December 2013, I said: Unfortunately, I'm getting lots of No route to host (EHOSTUNREACH) errors trying to send messages over a ROUTER socket. I think I may have found my problem. The 0MQ layer doesn't expose 0MQ IDs to its clients. Instead, every node has a human-readable name which

Re: [zeromq-dev] Identity and reconnection

2013-12-17 Thread Greg Ward
On 17 December 2013, Lindley French said: This is a bit of a novice question, but I can't find any answer to this in the Guide If a DEALER is connected to a ROUTER, and the underlying TCP connection goes down for some reason and is then reestablished, will the DEALER still have the same

Re: [zeromq-dev] Problem installing python language binding on openwrt

2013-12-11 Thread Greg Ward
On 09 December 2013, Roman said: Greg, thank you for answering. Sure, it is definitely known that it is impossible to compile C language programs on OpenWRT box itself. In case you need compilation, cross-compiler is used on another platform. In my case I already have zeromq library compiled

Re: [zeromq-dev] Problem installing python language binding on openwrt

2013-12-09 Thread Greg Ward
On 08 December 2013, Roman said: I tried to install python zeromq binding on openwrt issuing command python setup.py install. Script ended with the following error: unable to execute ccache_cc: No such file or directory error: command 'ccache_cc' failed with exit status 1 It sounds like

Re: [zeromq-dev] zeromq-buildbot

2013-12-06 Thread Greg Ward
On 05 December 2013, Matt Connolly said: What operating systems does Build Bot support? Or is it cross-platform / indifferent? Pretty much all of them. If Python and Twisted work, then BuildBot should work. BuildBot has a pretty steep learning curve. It's harder to do basic stuff than

[zeromq-dev] Migrating to 4.0

2013-12-06 Thread Greg Ward
Hi all -- I have an app running just fine on 0MQ 3.2.3 and pyzmq 13.1.0. Unfortunately it includes a homebrew cryptosystem that makes me nervous. I'd like to move to 0MQ 4.0 and use the builtin crypto there. I don't see any docs on porting to 0MQ 4.0... am I missing something? Or is it trivial --

Re: [zeromq-dev] thread affinity

2013-12-02 Thread Greg Ward
On 30 November 2013, Pieter Hintjens said: Hi Justin, This is an area of some debate. We've had patches to libzmq that made sockets thread safe, and removed those patches again. Sharing sockets between threads for the most part is bad for design and performance. However there are languages

[zeromq-dev] Poll on sockets OR child process

2013-11-27 Thread Greg Ward
Hi all -- I'm hacking on a task distribution system used internally here. It has N masters sending tasks (shell commands) out to M workers, and then doing stuff with the results. There's something that annoys me slightly about the implementation: the worker runs each task in a separate thread.

Re: [zeromq-dev] a general debugging issue in IPC communications.

2013-11-08 Thread Greg Ward
software that sucks *less*. Greg -- Greg Wardhttp://www.gerg.ca g...@gerg.ca @gergdotca ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

[zeromq-dev] More robust version of syncpub/syncsub example

2013-10-09 Thread Greg Ward
Hi all -- the ZeroMQ guide has an example, syncpub/syncsub, of a publisher and subscribers synchronizing over REQ/REP sockets before starting publishing in order not to lose messages. The example uses a sleep() to paper over the delay between the subscriber connect()ing to the publisher and