[zeromq-dev] Potential Memory Leak in JZMQ 2.x.x running on top of ZeroMQ 3.2.3 for Multicast Publishing?

[Chinmay Nerurkar]

Hi,

I wrote a simple test in java (JDK 7) for a ZeroMQ PUB socket publishing data 
over a MULTICAST channel on Windows 7 using OpenPGM 5.2.122. I tried JZMQ 
versions 2.2.0, 2.1.3 and 2.1.0 on top of ZeroMQ 3.2.3. The test file is as 
below.

import org.zeromq.ZMQ;

public class ZMQMulticastPubSocketTest
{
       public static void main(String[] args)
       {
              ZMQ.Context ctx = ZMQ.context(1);
              ZMQ.Socket pub = ctx.socket(ZMQ.PUB);
              pub.setLinger(0);
              pub.setRate(10000000);
              pub.setSendBufferSize(24000000);

              pub.connect("epgm://10.100.20.19;239.9.9.11:5556");
              //pub.bind("tcp://*:5556");
              while(true)
              {
                     pub.sendMore("TESTTOPIC");
                     
pub.send("Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_".getBytes(),
 0);
              }
       }
}

I notice that the memory footprint of the process keeps increasing till the 
computer runs out of memory. It doesn't crash (I am sure malloc() fails are 
internally handled). I also tried it on our linux servers and it went all the 
way to consuming 22 GB of ram before I took the process down. Is there a memory 
leak in the JZMQ wwrapper for multicast?

If I changed the code above to bind to a TCP address (line commented out) the 
memory footprint stayed stable and barely increased.

I also wrote a C version of the above code. This version is given below and it 
did not have the same growing memory footprint issue for multicast.

#include "stdafx.h"
#include "zmq.h"
#include "zmq_utils.h"
#include <assert.h>
#include <string>

static int
s_send (void *socket, char *string) {
    int size = zmq_send (socket, string, strlen (string), 0);
    return size;
}

static int
s_sendmore (void *socket, char *string) {
    int size = zmq_send (socket, string, strlen (string), ZMQ_SNDMORE);
    return size;
}

int main(int argc, char* argv[])
{
       void *context = zmq_ctx_new ();
       void *publisher = zmq_socket (context, ZMQ_PUB);
       int rc = zmq_bind (publisher, "epgm://10.100.20.19;239.9.9.11:5556");
       assert (rc == 0);
       long sockOpt = 1000000;
       rc = zmq_setsockopt (publisher, ZMQ_RATE, &sockOpt, sizeof(sockOpt));
       sockOpt = 0;
       rc = zmq_setsockopt (publisher, ZMQ_LINGER, &sockOpt, sizeof(sockOpt));
       sockOpt = 24000000;
       rc = zmq_setsockopt (publisher, ZMQ_SNDBUF, &sockOpt, sizeof(sockOpt));

       char* topic =  "TESTTOPIC";

       while(1)
       {
              s_sendmore(publisher, topic);
              s_send(publisher, 
"Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_Data_");
       }

       return 0;
}


Does anyone have any idea about why this may be happening?


Thanks.

Chinmay

_______________________________________________
zeromq-dev mailing list
zeromq-dev@lists.zeromq.org
http://lists.zeromq.org/mailman/listinfo/zeromq-dev