I assume you mean Qpid 0.5... this is pretty old, we are about to release 0.10.
Looking at the details of your email, I don't see the issue... perhaps you could clarify? 11 million msgs of size 5kB and assuming a 1-2kB overhead per message (typical) means you can count on each message consuming (say) 6-7kB. If you enqueue all messages, then the total message footprint in memory would be about 66-77GB - which could exceed the physical memory you have and would probably force you into swapping. This scenario is exactly what I would expect for the message size and quantities you describe. Also you don't mention how you measure the memory usage. On a side-note, I see that you are using the store, configured for 64 files of size 16384 (x64kB) which yields 64 files of 1GB = 64GB *per queue*. Even a fast disk system would take several minutes to format each one of these. I assume your use-case supports this. Also count on long recovery times for queues this large. Kim On Mon, 2011-04-11 at 14:41 -0700, vghariharan3 wrote: > Folks, > > I just want to check if anyone facing huge memory consumption issue with > qpid. We have a high end server with 64GB RAM which completely consumed by > Qpid while the queue hold 11 million messages (each message size around > 5KB). The qpid journal configuration is (64, 16384). We are using spring jms > based publisher and consumer for message publish and consumption. > > Qpid version: RHEL MRG (Qpid version 0.05 i believe) > > Thanks in advance. > > Harry > > -- > View this message in context: > http://apache-qpid-users.2158936.n2.nabble.com/Qpid-memory-consumption-tp6263045p6263045.html > Sent from the Apache Qpid users mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > Apache Qpid - AMQP Messaging Implementation > Project: http://qpid.apache.org > Use/Interact: mailto:[email protected] > --------------------------------------------------------------------- Apache Qpid - AMQP Messaging Implementation Project: http://qpid.apache.org Use/Interact: mailto:[email protected]
