Ok, can you merge this pull request please. https://github.com/zeromq/jzmq/pull/387
On Thu, Sep 3, 2015 at 12:17 PM, Pieter Hintjens <[email protected]> wrote: > Trevor, > > I see from http://zeromq.org/docs:tuning-zeromq#toc1 that OS/X has a > low default limit on file handles. Could be this. Zyre test cases tend > to consume a lot of file handles... > > -Pieter > > On Thu, Sep 3, 2015 at 5:09 PM, Trevor Bernard <[email protected]> > wrote: >> Adam, >> >> I was able to reliably recreate your error using JeroMQ on my MBP >> though I have yet to try on a Linux. When I did use JZMQ with >> libzmq-4.1.3, I would get: Resource temporarily unavailable >> (src/signaler.cpp:301) after a certain point in time. I'm wondering if >> this is mac specific? I'll set up a VM and retry the tests. >> >> -Trev >> >> On Thu, Sep 3, 2015 at 11:59 AM, Trevor Bernard >> <[email protected]> wrote: >>> Hi Adam, >>> >>> Building JZMQ is pretty straight forward: >>> >>> $ ./autogen.sh && ./configure && make && sudo ldconfig && mvn install >>> -Dgpg.skip=true >>> >>> I submitted a few patches to jyre this morning that made jeromq the >>> default. Also, if you want to test with JZMQ, you can just use the >>> follow branch in my fork: >>> https://github.com/trevorbernard/jyre/tree/jzmq >>> >>> You will need to mvn install jyre as well. >>> >>> I made some changes to your test here: >>> https://github.com/trevorbernard/jyre-standalone-benchmark >>> >>> I made the counters thread safe and I changed the gradle build to look >>> for artifacts in ~/.m2/repository >>> >>> Let me know how your testing goes. >>> >>> -Trev >>> >>> On Thu, Sep 3, 2015 at 9:19 AM, Wynne Adam (CR/RTC3.1-NA) >>> <[email protected]> wrote: >>>> Hi All, >>>> >>>> After talking with Pieter, I'm going to first do the test with a JNI >>>> wrapper for the zre lib. If anyone has built such a wrapper and is >>>> willing to share, please let me know :) >>>> >>>> Thanks >>>> Adam >>>> >>>> >>>> -----Original Message----- >>>> From: [email protected] >>>> [mailto:[email protected]] On Behalf Of Utsav Drolia >>>> Sent: Wednesday, September 02, 2015 10:17 AM >>>> To: ZeroMQ development list <[email protected]> >>>> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre >>>> >>>> Could you check where the messages do get dropped? >>>> Specifically, is there a buffer overflow at the pipe between the >>>> ZreInterface and the Agent? >>>> >>>>> On Sep 2, 2015, at 9:46 AM, Wynne Adam (CR/RTC3.1-NA) >>>>> <[email protected]> wrote: >>>>> >>>>> I simplified a bit and now explicitly wait for all responders to JOIN but >>>>> I'm getting the same results. I can't see any real difference between >>>>> your test and mine. I think my test is correct unless I'm doing >>>>> something really dumb that I can't see. >>>>> >>>>> Incidentally, if I lower the pause to 0, the ZreInterface.send() starts >>>>> blocking, which I think is the behavior we'd expect. >>>>> >>>>> We prefer to use the pure java version of Zyre so that we can use it in >>>>> Android. We'll use the C library for other platforms. >>>>> >>>>> >>>>> Best regards >>>>> >>>>> Adam Wynne >>>>> CR/RTC3.1-NA >>>>> >>>>> Tel. +1(412)390-3211 >>>>> >>>>> >>>>> -----Original Message----- >>>>> From: [email protected] >>>>> [mailto:[email protected]] On Behalf Of Pieter >>>>> Hintjens >>>>> Sent: Wednesday, September 02, 2015 3:30 AM >>>>> To: ZeroMQ development list <[email protected]> >>>>> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre >>>>> >>>>> It might be a Jyre issue yet the most likely seems an issue in your test >>>>> case (the loss is so dramatic). What I'd do is simplify it, and see when >>>>> it starts happening. >>>>> >>>>> If you are able to write a JNI layer then we could eventually wrap the >>>>> Zyre C API in Java. >>>>> >>>>> On Tue, Sep 1, 2015 at 11:10 PM, Wynne Adam (CR/RTC3.1-NA) >>>>> <[email protected]> wrote: >>>>>> OK. Do you think it's a problem in Jyre or JeroMQ? >>>>>> >>>>>> >>>>>> Best regards >>>>>> >>>>>> Adam Wynne >>>>>> CR/RTC3.1-NA >>>>>> >>>>>> Tel. +1(412)390-3211 >>>>>> >>>>>> >>>>>> -----Original Message----- >>>>>> From: [email protected] >>>>>> [mailto:[email protected]] On Behalf Of Pieter >>>>>> Hintjens >>>>>> Sent: Tuesday, September 01, 2015 2:19 PM >>>>>> To: ZeroMQ development list <[email protected]> >>>>>> Subject: Re: [zeromq-dev] message loss at high send rate in Jyre >>>>>> >>>>>> So here's a C test case that does this: >>>>>> https://gist.github.com/hintjens/d54d25c30e0339fb0a87 >>>>>> >>>>>> I do get message loss if I (a) start broadcasting before all nodes are >>>>>> ready or (b) don't wait for all messages to return. Otherwise it works >>>>>> even with no pause between message sends. >>>>>> >>>>>> -Pieter >>>>>> >>>>>> On Tue, Sep 1, 2015 at 11:25 AM, Pieter Hintjens <[email protected]> wrote: >>>>>>> Hi Adam, >>>>>>> >>>>>>> I'm recreating this test case in C/Zyre to see how it performs. >>>>>>> >>>>>>> -Pieter >>>>>>> >>>>>>> On Mon, Aug 31, 2015 at 4:39 PM, Wynne Adam (CR/RTC3.1-NA) >>>>>>> <[email protected]> wrote: >>>>>>>> Hi Everyone, >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> We are evaluating Jyre for use in a project and are doing some >>>>>>>> benchmark testing. We found that at higher send rates, some >>>>>>>> messages appear to get lost. I have created a github project with >>>>>>>> multiple “nodes” running in their own threads to demonstrate the >>>>>>>> issue. I included a README in the project that describes the test >>>>>>>> scenario and how to run it so it’s easy to run the test. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> https://github.com/awynne/jyre-standalone-benchmark >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> Please let me know if you have any ideas and/or are able to look into >>>>>>>> it. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> Best regards >>>>>>>> >>>>>>>> Adam Wynne >>>>>>>> >>>>>>>> Bosch Research and Technology Ctr. >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> _______________________________________________ >>>>>>>> zeromq-dev mailing list >>>>>>>> [email protected] >>>>>>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>>>>>> >>>>>> _______________________________________________ >>>>>> zeromq-dev mailing list >>>>>> [email protected] >>>>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>>>> _______________________________________________ >>>>>> zeromq-dev mailing list >>>>>> [email protected] >>>>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>>> _______________________________________________ >>>>> zeromq-dev mailing list >>>>> [email protected] >>>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>>> _______________________________________________ >>>>> zeromq-dev mailing list >>>>> [email protected] >>>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>> >>>> _______________________________________________ >>>> zeromq-dev mailing list >>>> [email protected] >>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >>>> _______________________________________________ >>>> zeromq-dev mailing list >>>> [email protected] >>>> http://lists.zeromq.org/mailman/listinfo/zeromq-dev >> _______________________________________________ >> zeromq-dev mailing list >> [email protected] >> http://lists.zeromq.org/mailman/listinfo/zeromq-dev > _______________________________________________ > zeromq-dev mailing list > [email protected] > http://lists.zeromq.org/mailman/listinfo/zeromq-dev _______________________________________________ zeromq-dev mailing list [email protected] http://lists.zeromq.org/mailman/listinfo/zeromq-dev
