Gordon What's the qpidd broker version that started support paging on queues ?
On Tue, Aug 26, 2014 at 5:53 AM, Gordon Sim <[email protected]> wrote: > On 08/24/2014 10:23 PM, Graham Leggett wrote: > >> I have a need to configure a very large queue that is able to store about >> 1 million messages of around 10kb each. The queue will be too big to fit >> into RAM, and will need to spool to disk. >> >> I have been struggling to configure the queue, as the queue seems to >> become full after a few thousand messages. Is there a definitive set of >> command line options to qpid-config that will create a queue bigger than >> RAM but that will fit on disk? >> > > Assuming you are using the c++ broker (since you mention qpid-config), if > you are using a relatively recent version then the best option would be a > paged queue. > > A baisc paged queue can be created with: > > qpid-config add queue my-paged-queue --argument qpid.paging=True > > You can control the number of pages held in memory with the > qpid.max_pages_loaded option and the size of the pages with the > qpid.page_factor option (which indicates how many multiples of the > platforms page size each qpidd page size is) > > If you are using the default value for default-queue-limit then you may > also want to explicitly make the queue infinite in size and turn off any > producer flow control which you could do by adding: > > --argument qpid.max_size=0 --argument qpid.max_count=0 --argument > qpid.flow_stop_size= 0 --argument qpid.flow_resume_size=0 --argument > qpid.flow_stop_count=0 --argument qpid.flow_resume_count=0 > > > > The errors we have received are related to qpid complaining that failover >> has failed - which is strange as there is just a single broker with no >> alternative brokers to fail over to. Does this ring a bell? >> > > What client are you using? Do you have the error in more detail? > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > >
