On 08/24/2014 10:23 PM, Graham Leggett wrote:
I have a need to configure a very large queue that is able to store about 1
million messages of around 10kb each. The queue will be too big to fit into
RAM, and will need to spool to disk.
I have been struggling to configure the queue, as the queue seems to become
full after a few thousand messages. Is there a definitive set of command line
options to qpid-config that will create a queue bigger than RAM but that will
fit on disk?
Assuming you are using the c++ broker (since you mention qpid-config),
if you are using a relatively recent version then the best option would
be a paged queue.
A baisc paged queue can be created with:
qpid-config add queue my-paged-queue --argument qpid.paging=True
You can control the number of pages held in memory with the
qpid.max_pages_loaded option and the size of the pages with the
qpid.page_factor option (which indicates how many multiples of the
platforms page size each qpidd page size is)
If you are using the default value for default-queue-limit then you may
also want to explicitly make the queue infinite in size and turn off any
producer flow control which you could do by adding:
--argument qpid.max_size=0 --argument qpid.max_count=0 --argument
qpid.flow_stop_size= 0 --argument qpid.flow_resume_size=0 --argument
qpid.flow_stop_count=0 --argument qpid.flow_resume_count=0
The errors we have received are related to qpid complaining that failover has
failed - which is strange as there is just a single broker with no alternative
brokers to fail over to. Does this ring a bell?
What client are you using? Do you have the error in more detail?
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
