Re: [zeromq-dev] ZeroMQ over WAN

2023-10-27 Thread Mark Botner
We've used ZeroMQ with TCP endpoints over WANs for years, via VPNS, stunnel, and direct connections and it works well. But we have seen the TCP Bandwidth-delay product slow us down: https://en.wikipedia.org/wiki/Bandwidth-delay_product Mark On Fri, Oct 27, 2023 at 12:20 PM Stéphane Valès via

Re: [zeromq-dev] detecting messages being dropped on a PUB socket?

2020-12-09 Thread Mark Botner
This page is empty for me: http://api.zeromq.org/master:zmq-socket-monitor-versioned Mark On Wed, Dec 9, 2020 at 5:28 AM Luca Boccassi wrote: > > On Wed, 2020-12-09 at 11:30 +0100, Francesco wrote: > > Hi Luca, > > sorry to jump into this thread: but > > > &g

[zeromq-dev] zmq_abort() called

2020-07-28 Thread Mark Botner
e ROUTING ID. I do have LINGER set to zero on the socket which is of ROUTER type. Is there a better way to prevent this problem or work around what I think is a deferred deletion of the ROUTING_ID? Thanks! Mark ___ zeromq-dev mailing list zeromq-dev

Re: [zeromq-dev] How to handle EINTR especially when using High-Level APIs as CZMQ

2020-03-28 Thread Mark Botner
Using a dedicated signal handling thread calling sigwait() might not be perfect, but I can attest that it works pretty well for most cases and that I've been using this technique on Linux for several years now. Good luck, Mark On Wed, Mar 25, 2020 at 1:13 AM Franz Hollerer wrote: > Af

Re: [zeromq-dev] One to Many synchronous messaging

2020-03-27 Thread Mark Botner
I'd recommend your publisher also creating a PULL socket, then have your subscribers create a PUSH socket and send responses back to the publisher over that connection. Mark On Fri, Mar 27, 2020 at 2:11 PM Jasper Jaspers wrote: > I have a publisher that needs to send a message to multi

Re: [zeromq-dev] How to handle EINTR especially when using High-Level APIs as CZMQ

2020-03-22 Thread Mark Botner
handling thread can deal with any received signals and all other threads don't have to process signals at all. Of course gracefully shutting down still requires a bit of planning, but I find that this is easier than dealing with EINTR everywhere. Mark On Sun, Mar 22, 2020 at 7:54 AM Franz Hollerer

Re: [zeromq-dev] Can ROUTER multiplex REQ/REP and PUB/SUB?

2019-03-27 Thread Mark Botner
According to the reference pages: http://api.zeromq.org/4-2:zmq-socket Summary of ZMQ_ROUTER characteristics Compatible peer sockets *ZMQ_DEALER*, *ZMQ_REQ*, *ZMQ_ROUTER* So I don't think the design you are looking at will work. Mark On Wed, Mar 27, 2019 at 8:50 AM Jake wrote: > I curren

Re: [zeromq-dev] why rtpapa.py example not running ?

2019-02-04 Thread Mark Botner
zmq-socket I would recommend changing both of your socket types to DEALER and try that. I think it will be closer to what you are looking for. Mark On Mon, Feb 4, 2019 at 3:25 AM Emile Achadde wrote: > Hello, > > I am new in 0MQ. > > I tried to run the example from there &g

Re: [zeromq-dev] TLS (openssl) for ZeroMQ

2018-12-28 Thread Mark Botner
I can confirm that ZeroMQ + Stunnel works extremely well. Stunnel is very robust - I'm using it to transfer many gigabytes / day over a 0MQ pub/sub connection and have been doing so now for almost 2 years continuously. Mark On Fri, Dec 28, 2018 at 2:50 PM Trevor Bernard wrote: > Why not j

Re: [zeromq-dev] Recovering a ROUTER socket

2018-08-24 Thread Mark Botner
Take a look at the setsockopt() call: ZMQ_IDENTITY: Set socket identity The *ZMQ_IDENTITY* option shall set the identity of the specified *socket* when connecting to a ROUTER socket. The identity should be from 1 to 255 bytes long and may contain any values. If two clients use the same identity

Re: [zeromq-dev] Pipeline Reliability

2018-07-03 Thread Mark Botner
I wonder if the default setting for ZMQ_LINGER is causing the zmq_close() to block since there are unsent messages? From the ref. guide: The default setting of *ZMQ_LINGER* does not discard unsent messages; this behaviour may cause the application to block when calling *zmq_ctx_term()*. ​Mark

Re: [zeromq-dev] What are the platform requirements

2018-06-17 Thread Mark Botner
Yes, 0MQ is a communications library, but it does require a OS. On Sun, Jun 17, 2018 at 3:58 PM, Henry Smith wrote: > Does 0MQ require an operating system (Linux, OSX, Windows, etc)? > > > > ___ > zeromq-dev mailing list > zeromq-dev@lists.zeromq.org

Re: [zeromq-dev] FBZMQ

2018-05-09 Thread Mark D via zeromq-dev
> I know for a fact that Facebook is using it, isn't that enough?:) You mean the ones with the motto "Move fast and break things"? Mark. ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Sharing socket safely between threads

2018-05-07 Thread Mark Botner
I've shared a zmq socket between threads and protected it with Mutex and it works just fine. I've also used the "inproc" transport to allow threads to communicate with each other and relay messages to a socket that isn't shared between threads. Mark On Mon, May 7, 2018 at 8:42

Re: [zeromq-dev] Pub/Sub scalability over TCP vs epgm/pgm

2018-04-09 Thread Mark Delany
atching trie.?? Worst case is O(length of > longest topic).?? If topic names are reasonably short, it's negligible on > a modern cpu. Thanks Colin, good to know. So yes, 500 topics should be trivial. Measure measure measure. Mark. ___ zeromq-

Re: [zeromq-dev] Pub/Sub scalability over TCP vs epgm/pgm

2018-04-09 Thread Mark Delany via zeromq-dev
r message would happen pretty quickly on a modern CPU. I am assuming that zeromq does better than linear since topics are exact prefix match there are plenty of alogrithmic solutions that are far faster than O(n). A number of vmstat samples will give a general idea of what's going o

Re: [zeromq-dev] Multiple connects with a ZMQ_REQ socket appears not to work

2018-02-23 Thread Mark via zeromq-dev
ood now that I know better. Mark. ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org https://lists.zeromq.org/mailman/listinfo/zeromq-dev

[zeromq-dev] Multiple connects with a ZMQ_REQ socket appears not to work

2018-02-22 Thread Mark
ongly? What I'm trying to achieve is running the same REQ/REP server on multiple systems for redundancy and use 0MQ to automatically find a working server on behalf of the client. Mark. // Hello World server #include #include #include #include #include int main (void) { void *context

[zeromq-dev] Need a pattern suggestion

2017-12-08 Thread Mark Holbrook
Hi all, We are going to be writing a Windows Service app which will hopefully listen for incoming data from our main application and write it to a database then to the cloud. I'm struggling with one basic understanding problem on how to do this... The Windows Service app will likely

Re: [zeromq-dev] PUB/SUB model and time-ordering SUB-side

2017-12-06 Thread Mark Holbrook
ct: Re: [zeromq-dev] PUB/SUB model and time-ordering SUB-side Hi Mark, have a look at ZMQ_XPUB_NODROP socket option. Despite the name, it applies also to PUB sockets (not only XPUB) and allows you to have a PUB/SUB without drops. I'm using that in my applications all the times. Btw I'm sending Mpps t

Re: [zeromq-dev] PUB/SUB model and time-ordering SUB-side

2017-12-06 Thread Mark Holbrook
2x messages now. Add a third RX and I start to see message loss sporadically. I would be more than willing to post some code but wanted to just see if I'm in the ballpark with this idea first. Thanks - Mark

Re: [zeromq-dev] R.I.P. Pieter Hintjens

2017-12-03 Thread Mark Botner
using ZeroMQ at my new job/company and often put in the comments "RIP Pieter Hintjens". Maybe someone who reads the comments later on will bother to figure out who he was. Thanks, Mark On Sun, Dec 3, 2017 at 6:28 PM, Osiris Pedroso <opedr...@gmail.com> wrote: > Today i

[zeromq-dev] Status of ZMQ for .NETCore

2017-11-16 Thread Mark Holbrook
Hi all, We are about to embark on a new big project and a large majority of our developers are pushing hard to focus on Universal Windows and .NETCore as they see it as the future. Our app will need to gather fairly high speed data from our instrument over TCP/IP. I am concerning that one

Re: [zeromq-dev] Sending object pointers to threads using ZMQ_SEND over ZMQ_PAIR Socket

2016-12-20 Thread Mark Botner
r is an un-initialized pointer. It should probably be like this: struct example buffer; int size = zmq_recv(receiver,,sizeof(buffer),0); Mark On Tue, Dec 20, 2016 at 6:14 AM, Shrikanth M.D. <shrikanthdiwa...@gmail.com> wrote: > Hi, > > I have tried a small piece of code as in he

Re: [zeromq-dev] Using CurveZMQ to secure multiple sockets?

2016-10-05 Thread Mark Gillott
t. > OK so authentication/encryption needs to be (separately) applied to every socket. And if some other part of the system springs up a socket between client & server for its own use, it has to remember to build in the zauth/zcert calls. Mark > On 5 October 2016 at 09:27, Mark Gillott

[zeromq-dev] Using CurveZMQ to secure multiple sockets?

2016-10-05 Thread Mark Gillott
d? Can I build a CurveZMQ-based "pipe" over which other 0MQ sockets can operate? Thanks, Mark ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

[zeromq-dev] 4.1.x Windows Package

2016-03-14 Thread Mark Studenka
a package exist and the web pages haven't been updated or do I need to build myself if I'd like a current Windows package? Thanks for any help. -mark ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Access to underlying Linux socket?

2016-02-11 Thread Mark Gillott
On Wed, 2016-02-10 at 23:33 +, Luca Boccassi wrote: > On Feb 10, 2016 20:39, "Mark Gillott" <mgill...@brocade.com> wrote: > > > > On Wed, 2016-02-10 at 20:45 +0100, Pieter Hintjens wrote: > > > You can't do this really, since one ZeroMQ soc

Re: [zeromq-dev] Access to underlying Linux socket?

2016-02-11 Thread Mark Gillott
the ZMQ_USE_FD option solves the issue for listener (bind) sockets. Unfortunately there needs to be a different solution for when an application wants to set an option prior to a ZeroMQ connect (need the option to be persistent across "reconnects"). Kicking around a few ideas. Mark _

[zeromq-dev] Access to underlying Linux socket?

2016-02-10 Thread Mark Gillott
tches for the base ZMQ library (together with the various language binding - C, Python, Perl, etc)? Cheers, Mark ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Access to underlying Linux socket?

2016-02-10 Thread Mark Gillott
k just prior to any bind/connect. Is that the idea? In czmq terms, something like: s = zsock_new(ZMQ_REP) zsock_configure(s, myfunc, myarg) zsock_bind(s) The callback would be provided with the base socket? Thanks, Mark > -Pieter > > On Wed, Feb 10, 2016 at 6:29 PM, Jerry Scharf > &l

Re: [zeromq-dev] zmq_socket_monitor Issue

2015-12-09 Thread Mark Studenka
though it appears to be fixed. -mark On Tue, Dec 8, 2015 at 8:48 AM, Mark Studenka <mstude...@perseus.co> wrote: > Thanks. I just wanted to make sure that at least my sample code looked > like I was doing the correct thing before assuming there may be a bug. > > I'll see what I c

Re: [zeromq-dev] zmq_socket_monitor Issue

2015-12-08 Thread Mark Studenka
Thanks. I just wanted to make sure that at least my sample code looked like I was doing the correct thing before assuming there may be a bug. I'll see what I can find by digging into the libzmq code. -mark On Tue, Dec 8, 2015 at 8:02 AM, Pieter Hintjens <p...@imatix.com> wrote: > T

[zeromq-dev] zmq_socket_monitor Issue

2015-12-07 Thread Mark Studenka
having. Any help or tips would be appreciated. If my sample code looks ok I'll start digging down into the ZeroMQ code a little more to try to track down what could be happening. Thanks. -mark ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http

Re: [zeromq-dev] missing messages on 40GbE network

2015-07-07 Thread A. Mark
Hello, Are you doing extensive error checking with ZMQ? If you are flooding the network, some of your ZMQ clients may be timing out on either end and the sockets maybe simply closed before they have a chance to send/recv anything? Mark On Tue, Jul 7, 2015 at 8:36 AM, Thomas Rodgers rodg

[zeromq-dev] ZeroMQ Web browser / Node.js / hZmqSocket.js

2015-04-24 Thread Kornfein, Mark M (GE Global Research)
Can either be used why the flash solution if there is a node,js solution? BTW I am completely new to ZMQ and tried looking through the archive online but saw no way to search it? Thanks, Mark ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org

[zeromq-dev] attempting to build c++ version of paranoid pirate from the guide - is zmsg.hpp available

2014-12-18 Thread Mark Andrews
hi all, new to zeromq and working through some of the examples in the zeromq guide. I've looked around zeromq on github and am not finding the c++ port of czmq's zmsg.h  referred to in the zeromq guide's paranoid pirate queue c++ example  Where might I find a version of zmsg.hpp which will make

[zeromq-dev] When I do lots of zmq_socket/zmq_close couples, it crashes

2014-11-25 Thread Mark Wright
there's no good way to, say, force a per-thread initialization process on the client. I'm avoiding using TLS or something like that until I know I have to) Thanks, Mark -- Mark Wright markscottwri...@gmail.com ___ zeromq-dev mailing list zeromq-dev

[zeromq-dev] Is there a ZMQ-specific license file?

2014-11-11 Thread Mark Wright
The COPYING.LESSER file (from here: https://github.com/zeromq/libzmq/blob/master/COPYING.LESSER) is the generic LGPL+exception. Is there any sort of ZMQ-specific version? Are there attributions that need to be made? Thanks, Mark -- Mark Wright markscottwri...@gmail.com

[zeromq-dev] It looks like socket id's can't change with a router-router topology. Is that correct?

2014-09-17 Thread Mark Wright
= zmq_ctx_destroy (ctx); if (rc == -1) return 1; return 0; } -- Mark Wright markscottwri...@gmail.com ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] libcurve make check failed

2014-09-01 Thread A. Mark
already, causes the client bind to fail. I'm investigating... On Sat, Aug 30, 2014 at 3:43 AM, A. Mark gougol...@gmail.com wrote: commit 194be05556f819513a6ace77ad386b9eb3ba1942 Merge: 4767fa6 1919f43 Author: Pieter Hintjens p...@imatix.com Date: Fri Jul 4 08:48:37 2014 +0200

Re: [zeromq-dev] Zeromq on IBM Mainframe server ?

2014-09-01 Thread A. Mark
Hello, I have compiled and used ZMQ on AIX6.1 64 bit OS if that helps. The difficulty may be in setting up the build system, after that it builds without issues. If you let us know what you are having trouble with someone may be able to help you. M. On Mon, Sep 1, 2014 at 9:03 PM, Ranjeet

[zeromq-dev] libcurve make check failed

2014-08-29 Thread A. Mark
make[2]: Leaving directory `/home/alian/Desktop/Temp/libcurve/src' make[1]: *** [check-am] Error 2 make[1]: Leaving directory `/home/alian/Desktop/Temp/libcurve/src' make: *** [check-recursive] Error 1 Mark ___ zeromq-dev mailing list zeromq-dev

Re: [zeromq-dev] C# Usage

2014-06-09 Thread mark
I'm using v3 of clrzmq in a production application with no issues. The v3 API is much nicer than v2 and worth the upgrade. AFAIK NetMq is not production ready. On Mon, Jun 9, 2014 at 11:00 AM, zeromq-dev-requ...@lists.zeromq.org wrote: Send zeromq-dev mailing list submissions to

[zeromq-dev] Hanging tests in TeamCity

2014-05-28 Thread mark
I am using C# and clrzmq and have a number of nunit tests that test two inproc endpoints sending and receiving messages. All objects are disposed properly and all tests run to green, however Team City test runner shows a hanging build, clearly something is being kept alive somewhere.. Has anyone

[zeromq-dev] How to exit a blocking Receive call cleanly?

2014-05-19 Thread mark
I have a blocking Receive call that runs on a background thread for as long as the logical endpoint has not be stopped. The call to terminate an endpoint comes from a different thread, meaning the blocking Receive call throws some kind of exception - ObjectDisposed, SEH or AccessViolation. Is

Re: [zeromq-dev] Resource puzzle with the Divide and Conquer (Ventilator-Workers-Sink) Example

2014-04-30 Thread Mark Hotchkiss
this on has 128 Gibabytes of installed memory. Any help you can offer with this example would be appreciated.  Thanks. On Wednesday, April 30, 2014 3:54 AM, Pieter Hintjens p...@imatix.com wrote: On Wed, Apr 30, 2014 at 1:09 AM, Mark Hotchkiss mark.hotchk...@yahoo.com wrote: If I push the number

Re: [zeromq-dev] ZMQ Message Size Limitations

2014-04-11 Thread Mark Hotchkiss
the message and immediately calling free() after sending. Do you think it is possible that the memory is being freed too soon before the message completes sending? In the meantime, I am going to run this in a debugger to see where it is actually crashing. Mark On Friday, April 11, 2014 12:29 AM

[zeromq-dev] How can I do REQ REP where I don't care about the reply?

2014-04-10 Thread mark
I want multiple clients to send commands/messages to a single endpoint. I don't care about the endpoint sending a reply back to the clients. Its fire and forget. I'm using REQ REP at the moment but I'm forced to receive a reply, which isn't what I want... Is there a pattern for what I need?

Re: [zeromq-dev] Pluggable Transport Protocol

2014-04-10 Thread Mark Hotchkiss
Gentlemen: Is there some reason that you took over my thread on Message Size Limitations and changed it to Pluggable Transport Protocol without anyone referencing my issue? I guess I will re-submit my question under another thread to see if it might get some attention. Mark On Thursday

Re: [zeromq-dev] ZMQ Message Size Limitations

2014-04-10 Thread Mark Hotchkiss
, April 10, 2014 12:40 PM, Pieter Hintjens p...@imatix.com wrote: Hi Mark, There's no clear reason the ventilator would kill itself when sending a larger message. Can you strip down the case to a minimal one, that we can reproduce? Thanks, -Pieter On Wed, Apr 9, 2014 at 10:26 PM, Mark Hotchkiss

[zeromq-dev] Patterns for recovery...

2014-04-10 Thread mark
Can anyone point me towards some C# patterns or general guidelines for writing endpoints that can recover gracefully after failure? Should you dispose of the context for example, or just the socket? Should you call terminate, or dispose? Etc... (I've seen the lazy pirate pattern for client's

Re: [zeromq-dev] ZMQ Message Size Limitations

2014-04-10 Thread Mark Hotchkiss
will stop without further action. I hope this helps. Thanks. Mark On Thursday, April 10, 2014 2:39 PM, Pieter Hintjens p...@imatix.com wrote: Hi Mark, There's no clear reason the ventilator would kill itself when sending a larger message. Can you strip down the case to a minimal one, that we can

[zeromq-dev] How to create an efficient ZMQ message receiver in C#?

2014-04-09 Thread mark
Most trivial ZMQ examples use a spinning loop to receive messages, like so: *while (true)* *{* * // Wait for next request from client* * string message = server.Receive(Encoding.Unicode);* * //.* *}* Which obviously ties up a thread. Is there a better way (preferably in C#) to wait

[zeromq-dev] 2ms roundtrip with python bindings

2014-03-27 Thread Mark
I modified the hello world client to time a single send and recv across my network and get 1.6ms: python hwclient.py Connecting to hello world server... 1.62792205811 World Running the perf latency test I get: message size: 1 [B] roundtrip count: 1 average latency: 113.799 [us] I've

Re: [zeromq-dev] 2ms roundtrip with python bindings

2014-03-27 Thread Mark
Mark markreed99 at gmail.com writes: I modified the hello world client to time a single send and recv across my network and get 1.6ms: Note that I removed the sleep from hwserver.py. import time import zmq context = zmq.Context() socket = context.socket(zmq.REP) socket.bind(tcp://*:port

Re: [zeromq-dev] Will automatically retrying a connection re-resolve the dns name first?

2014-03-19 Thread Mark Barbisan
Isn't this only in the master branch at the moment (PR 921) or was there some additional logic for this that was present in earlier versions? -Original Message- From: zeromq-dev-boun...@lists.zeromq.org [mailto:zeromq-dev-boun...@lists.zeromq.org] On Behalf Of Pieter Hintjens Sent:

[zeromq-dev] Is the JeroMQ available via Maven have the issue #34 fix?

2014-03-02 Thread Mark Wright
something got pushed to the maven repository. -- Mark Wright markscottwri...@gmail.com ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] Is there a guide on how to set up encryption for ZMQ?

2014-02-17 Thread Mark Wright
? Or must all servers have the same key pair if I do multiple zmq_connect() calls? Is there documentation for function calls like zsocket_set_curve_serverkey? -- Mark Wright markscottwri...@gmail.com ___ zeromq-dev mailing list zeromq-dev

[zeromq-dev] Is there a guide on how to set up encryption for ZMQ?

2014-02-15 Thread Mark Wright
I'm looking to at least encrypt messages on the wire, at most to mutually authenticate clients and servers. The CurveZMQ site says that it's experimental - is it not ready for use? Is there a timeline for JeroMQ support? -- Mark Wright markscottwri...@gmail.com

Re: [zeromq-dev] Call for funding? (Not a roadmap, promise!)

2014-01-20 Thread Mark Marsella
Yeah I would donate also. Is CZMQ is already compliant? On 20 January 2014 13:34, Kenneth Adam Miller kennethadammil...@gmail.comwrote: Open a donation line I will give. On Mon, Jan 20, 2014 at 7:32 AM, Pieter Hintjens p...@imatix.com wrote: Hi all, I'm thinking of organizing a fund

Re: [zeromq-dev] Call for funding? (Not a roadmap, promise!)

2014-01-20 Thread Mark Marsella
, sounds positive. I'll launch an indiegogo campaign when I get back home from my current trip. On Mon, Jan 20, 2014 at 7:37 AM, Mark Marsella mark.marse...@gmail.com wrote: Yeah I would donate also. Is CZMQ is already compliant? On 20 January 2014 13:34, Kenneth Adam Miller kennethadammil

[zeromq-dev] ZHeartbeat

2014-01-18 Thread Mark Marsella
, it just needs functions to add/remove endpoints to send to, and I plan to take a stab at it soon. Regards Mark Marsella ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] ZHeartbeat

2014-01-18 Thread Mark Marsella
Hi Pieter, Yes, the service module sounds more useful and at a better level of abstraction for the library. I will take a look at it. Thanks Mark On 18 January 2014 12:58, Pieter Hintjens p...@imatix.com wrote: Hi Mark, I started on a zservice module with a very similar intention

[zeromq-dev] CZMQ: Memory leak in zbeacon

2014-01-16 Thread Mark Marsella
==30415== suppressed: 0 bytes in 0 blocks ==30415== ==30415== For counts of detected and suppressed errors, rerun with: -v ==30415== ERROR SUMMARY: 1 errors from 1 contexts (suppressed: 2 from 2) Regards Mark Marsella ___ zeromq-dev mailing list

Re: [zeromq-dev] ZMQ_ROUTER internals

2013-09-03 Thread A. Mark
to handle very large number of workers/resources so it should be ok. Mark On Tue, Sep 3, 2013 at 12:23 AM, Pieter Hintjens p...@imatix.com wrote: The keys are short numbers. I've not seen a profile of the cost of using router sockets that shows any hotspots. This would be worth doing before any real

[zeromq-dev] ZMQ_ROUTER internals

2013-09-02 Thread A. Mark
assume using smaller length identity somewhat reduces the overhead of routing? Aside from that I'm wondering is there any other precaution to take if one wants to have a very tightly bound lowest latency router (broker) over inproc? Any input is appreciated. Mark

Re: [zeromq-dev] Using the full bandwidth of a 10 GBps link on Windows 7

2013-07-03 Thread A. Mark
Hi! Could you provide the command line you used for local_thr/remote_thr? Also the screen shot of task manager network and CPU would be useful during bechmarks? I have ran several high perf benchmarks for ZMQ and maybe able to help you. Regards, Attila Mark On Wed, Jul 3, 2013 at 8:46 AM

Re: [zeromq-dev] ROUTER sockets and IDENTITY

2013-07-02 Thread Mark Barbisan
. This new behaviour could be enabled via a new flag for zmq_setsockopt. However, it would have to assume a trusted/secured network. What do you think? - Mark. -Original Message- From: zeromq-dev-boun...@lists.zeromq.org [mailto:zeromq-dev-boun...@lists.zeromq.org] On Behalf Of Pieter

[zeromq-dev] ROUTER sockets and IDENTITY

2013-06-27 Thread Mark Barbisan
it into a list of anonymous connections. The client has no way of receiving responses. Does ZeroMQ provide a facility to reassign identities for the clients of ROUTER sockets? Thanks, - Mark. ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http

Re: [zeromq-dev] PUB/SUB appears to be 'missing' first byte 3.2.2

2013-05-21 Thread Mark Sutheran
Hi Trevor, Siam Thanks for the responses. Rebuilt jzmq on the device and the problem disappeared. Siam - I think you're right, the zmq.jar I was distributing with the code was not fully compatible with the jni layer/zmq installed on the target machine. Ah jni... Thanks again, Mark

Re: [zeromq-dev] PUB/SUB appears to be 'missing' first byte 3.2.2

2013-05-19 Thread Mark Sutheran
, -49, 0, 0] Non-blocking pub:[7, 0, 0, 13, -49, 0, 0] ...received data:[0, 0, 13, -49, 0, 0] Regards, Mark Jzmq test case: /*/ package zmqtest; import java.util.Arrays

[zeromq-dev] PUB/SUB appears to be 'missing' first byte 3.2.2

2013-05-18 Thread Mark Sutheran
Hi, I appear to have a issue with PUB/SUB apparently 'dropping' the first byte. Setup:   * Basic PUB/SUB running on same machine over TCP/localhost.   * Message has first 4 bytes as subscription id, rest payload Problem:  * On dev box runs fine  * On prod box the subscriber sees no messages   

[zeromq-dev] sync examples from guide fail on Java and C/C++

2013-04-23 Thread Mark Obsniuk
3.2.2 code for zeromq. This has been tested on linux and OS X. Mark ___ zeromq-dev mailing list zeromq-dev@lists.zeromq.org http://lists.zeromq.org/mailman/listinfo/zeromq-dev

Re: [zeromq-dev] 0MQ for hard real time applications: the inproc communication

2013-04-18 Thread A. Mark
Hello Davide, I'm not certain about the implementation of the inproc in ZMQ but I'm pretty certain it is using pipes. I'm interested in working on this issue since I've an MPMC queue implemented using ZMQ inproc and ZMQ_ROUTER and latency is critical of course. If we can improve latency in this

Re: [zeromq-dev] 0MQ for hard real time applications: the inproc communication

2013-04-18 Thread A. Mark
On that subject are there straightforward ways to tweak inproc latency in the ZMQ configuration, besides msg and socket options? On Thu, Apr 18, 2013 at 8:46 AM, Martin Hurton hurt...@gmail.com wrote: You have some control over memory allocation when transporting message using ypipes. See

Re: [zeromq-dev] Marshalling / Routing

2013-04-15 Thread A. Mark
Hi Lee, The PUB socket is neutral towards SUBscribers that's why it's a publisher. Depending on what you are trying to achieve with your mesh you may need to use different socket pair if you need such filtering. Did you try XPUB/XSUB? On Sun, Apr 14, 2013 at 10:47 PM, Lee Sylvester

Re: [zeromq-dev] A simple Request-Reply architecture is much slower than expected.

2013-04-12 Thread A. Mark
Can you supply the entire code? Your dealer and router are running in separate threads right? On Fri, Apr 12, 2013 at 7:19 PM, crocket crockabisc...@gmail.com wrote: There is Double Read(String name) method, and it takes 50~60ms to call Read() 1000 times. I made two message queues that are

Re: [zeromq-dev] DEALER and ROUTER to send and receive

2013-04-09 Thread A. Mark
It is difficult to help without understanding more detail about your application, in general yes you can send/recv in any order on router/dealer. On Tue, Apr 9, 2013 at 3:38 PM, Rahul Piyali Ray 8429oakm...@gmail.comwrote: Hi Gurus, I have implemented a dealer (server) and router ( as

Re: [zeromq-dev] Is it possible to get deadlocks in ZeroMQ applications?

2013-04-08 Thread A. Mark
Yes I agree, I've not had a single deadlock in a classic sense since using message queues. But this statement is like saying I've hand not a car accident since I've been riding a bike. You can still lock up your code but it will not be a classic deadlock. I guess you could incorrectly code

Re: [zeromq-dev] How to print multi part message

2013-04-08 Thread A. Mark
An example of the code segment in question would be helpful. On Mon, Apr 8, 2013 at 10:06 AM, West Madison 8429oakm...@gmail.com wrote: Hi, I am stuck at a simple problem of printing a multi part string message in C++. Nothing seems to work the way I wrote. I see the correct length of

Re: [zeromq-dev] Is it possible to get deadlocks in ZeroMQ applications?

2013-04-08 Thread A. Mark
8, 2013 at 11:52 AM, A. Mark gougol...@gmail.com wrote: Yes I agree, I've not had a single deadlock in a classic sense since using message queues. But this statement is like saying I've hand not a car accident since I've been riding a bike. You can still lock up your code

Re: [zeromq-dev] Which language binding/API to use such that the process uses least RAM

2013-04-04 Thread A. Mark
ZMQ's memory utilization while messaging will - among other things - depend on the zmq socket options and how you implement messaging. It sounds like you are going to be exchanging small messages and not transferring very large chunks, you should be able to reduce memory usage of zmq. My first

Re: [zeromq-dev] Which language binding/API to use such that the process uses least RAM

2013-04-04 Thread A. Mark
to do- however I dont know if its possible. Yours sincerely, Arvind, Creatrix IT Soft. *From:* A. Mark gougol...@gmail.com *Sent:* Friday, April 5, 2013 12:19 AM *To:* ZeroMQ development list zeromq-dev@lists.zeromq.org *Subject:* Re: [zeromq-dev] Which language binding/API to use

Re: [zeromq-dev] ZeroMQ Newbie

2013-04-03 Thread A. Mark
Here is one: asyncsrv: Asynchronous client/server in C http://zguide.zeromq.org/page:all On Wed, Apr 3, 2013 at 4:02 AM, A L alapex0...@gmail.com wrote: Hi Mark, I'd be thankful if you could please point me to those multi-threading examples using 0mq in the 0mq guide. Or just give me

Re: [zeromq-dev] Which language binding/API to use such that the process uses least RAM

2013-04-03 Thread A. Mark
I think in general you have the most control over your memory allocation using C. On Wed, Apr 3, 2013 at 2:11 PM, Arvind Creatrix IT Soft arv...@creatrixitsoft.com wrote: Hi I wish to create a simple process that basically measures the CPU/RAM utilisated by a running process on that

Re: [zeromq-dev] ZeroMQ Newbie

2013-04-02 Thread A. Mark
Yes you can certainly use multiple threads besides zmq's own threads. There are many examples of this in the zmq guide. On Tue, Apr 2, 2013 at 2:38 AM, A L alapex0...@gmail.com wrote: Hi Eric, Thanks for replying. I also want to know if, in addition to using my own thread, I can use

Re: [zeromq-dev] Sending via ROUTER socket to ROUTER socket fails initially with No route to host

2013-03-26 Thread A. Mark
I see, so since it's unrestricted it's fine with ROUTER to ROUTER, but with REQ-ROUTER is not going to work. On Tue, Mar 26, 2013 at 2:55 PM, Anoop Karollil anoop.karol...@gmail.comwrote: Pieter Hintjens wrote: On Tue, Mar 26, 2013 at 10:09 PM, Anoop Karollil anoop.karol...@gmail.com wrote:

Re: [zeromq-dev] Sending via ROUTER socket to ROUTER socket fails initially with No route to host

2013-03-25 Thread A. Mark
eventually somewhere. -Mark On Mon, Mar 25, 2013 at 4:53 PM, Anoop Karollil anoop.karol...@gmail.comwrote: Hello, I am using ZeroMQ 3.2.2 and PyZMQ 13.0.0. When I try sending messages via a ROUTER socket to a ROUTER socket (both having their identities set), with ZMQ_ROUTER_MANDATORY set

Re: [zeromq-dev] Authenticate a given client connection

2013-03-14 Thread A. Mark
Hi Alexandre, Not certain what you mean by authentication but I have been thinking of this ZMQ area just recently. What I did and I'm not sure that it is relevant to your case is to have a ZMQ_ROUTER to ZMQ_ROUTER broker as the server frontend+backend. I authenticate via the identity first which

Re: [zeromq-dev] Authenticate a given client connection

2013-03-14 Thread A. Mark
I can think of making this easier if the ZMQ identites could be renegotiated, that way portion of the ID could be reserved for negotiation and then used as references. Don't know if this fits well with ZMQ's internals though. -Mark On Thu, Mar 14, 2013 at 9:10 AM, A. Mark gougol...@gmail.com

Re: [zeromq-dev] PUSH/PULL lost messages (once again)

2013-03-08 Thread A. Mark
at some point which is not true in general, same for the second loop. The argv[2] link will not transmit any messages until it is connected, and yes ZMQ will queue messages so it may appear that you have sent messages even if the endpoint is not connected. -Mark On Fri, Mar 8, 2013 at 2:58 AM, Pieter

Re: [zeromq-dev] PUSH/PULL lost messages (once again)

2013-03-08 Thread A. Mark
...Not sure that English is your first language but FYI saying be quiet is quite rude since you do not really know my age, second you are the one asking a question...I'm glad you figured it out :) -Mark On Fri, Mar 8, 2013 at 10:44 AM, Jean-François Smigielski jf.smigiel...@gmail.com wrote

Re: [zeromq-dev] perf/throughput tests calculates bandwith wrong

2013-02-25 Thread A. Mark
Meant to write: should be at least: throughput = (unsigned long)((double) message_count / (double) elapsed * (double)( 1024*1024)); On Mon, Feb 25, 2013 at 5:39 AM, A. Mark gougol...@gmail.com wrote: Hi, I've done some extensive benchmarks using local_thr and remote and tcp in the last

Re: [zeromq-dev] perf/throughput tests calculates bandwith wrong

2013-02-25 Thread A. Mark
Would you share the basic hardware and setup of the 10GE you are testing on? On Mon, Feb 25, 2013 at 5:41 AM, A. Mark gougol...@gmail.com wrote: Meant to write: should be at least: throughput = (unsigned long)((double) message_count / (double) elapsed * (double)( 1024*1024)); On Mon

Re: [zeromq-dev] perf/throughput tests calculates bandwith wrong

2013-02-25 Thread A. Mark
Thanks Pieter, I've missed the contributing page...I will submit a pull request shortly. Mark On Mon, Feb 25, 2013 at 6:15 AM, Pieter Hintjens p...@imatix.com wrote: On Mon, Feb 25, 2013 at 2:39 PM, A. Mark gougol...@gmail.com wrote: I've done some extensive benchmarks using local_thr

Re: [zeromq-dev] ZMQ vs FF

2013-01-19 Thread A. Mark
would be a single broker controlling the ring buffer state to which clients connect to, request buffers and submit finished buffers. I think a REQ-DEALER-ROUTER-REP chain should be able to handle this. I will have to add a controller somehow too. On Thu, Jan 17, 2013 at 9:39 AM, A. Mark gougol

Re: [zeromq-dev] ZMQ vs FF

2013-01-17 Thread A. Mark
), if it also less wasteful for unnecessary wake-ups. I'm only learning ZMQ and no very little about FF. Interesting article, I wish I could use it... On Thu, Jan 17, 2013 at 6:04 AM, Steven McCoy steven.mc...@miru.hk wrote: On 17 January 2013 01:35, A. Mark gougol...@gmail.com wrote: I'm needing

[zeromq-dev] ZMQ vs FF

2013-01-16 Thread A. Mark
Hello, I'm needing to implement some low level MPMC queues. I've been rolling my own using pthreads, and so far I've been pulling my hair out in the process also... My code is strictly C at this point and I'd like to keep it that way. I've looked into FF (FastFlow) and find it's rather technical

Re: [zeromq-dev] Segfault in zmq_data_init or related

2013-01-11 Thread A. Mark
Thanks Charles, Not sure how to open an issue...by the way it looks like if I remove the zmq_msg_close it works OK. On Fri, Jan 11, 2013 at 9:43 AM, Charles Remes li...@chuckremes.com wrote: On Jan 11, 2013, at 11:32 AM, A. Mark gougol...@gmail.com wrote: The segfault occurs in the first

  1   2   >