Re: [AMQ] Queue size grows infinitely

2021-10-05 Thread Balamurugan Seenivasan
HI, Thanks for your reply. Here is one snapshot from today. 426801(pending) 8 (consumers) 609146 (enqueued) 182345(dequeued) As per this stats, We seem to have about 426801 pending messages (same number of records exist in DB too) and produced more than 600K messages while we only

Re: [AMQ] Queue size grows infinitely

2021-10-05 Thread Balamurugan Seenivasan
HI, Thanks for your reply. We started to see the queue size growing in production recently. Following are some of the things we have tried so far We initially were on AMQ version 5.15.10 and JDBC driver version 4.2. We upgraded both AMQ as well as JDBC driver to the latest (5.16.3 and

Re: [AMQ] Queue size grows infinitely

2021-10-04 Thread JB Onofré
Can you elaborate a bit your analyze and test case ? Thanks Regards JB > Le 5 oct. 2021 à 07:20, Balamurugan Seenivasan a écrit : > > Hi, > > Thanks for your reply. > > This issue exists for us even if we start out with a clean environment (with > a brand new database). > We even noticed

Re: [AMQ] Queue size grows infinitely

2021-10-04 Thread Balamurugan Seenivasan
Hi, Thanks for your reply. This issue exists for us even if we start out with a clean environment (with a brand new database). We even noticed this issue with KahaDB too. This is consistently reproducible for us. Regards, Bala On 2021/10/01 17:56:07, Matt Pavlovich wrote: > Hi Balamurugan-

Re: [AMQ] Queue size grows infinitely

2021-10-04 Thread Balamurugan Seenivasan
Hi Tim, Thanks for your reply. It doesn't appear to be a statistics issue. We see same number of records in the database too. Once it hits certain numbers (3 million in our case), things start to slow down and affect performance badly. The workaround that we have in place is to cleanup the DB

Re: [AMQ] Queue size grows infinitely

2021-10-01 Thread Matt Pavlovich
Hi Balamurugan- Is the broker restarted at any time in this sequence of events? Keep in mind— Pending Count can be higher than Enqueue Count when the broker is restarted and messages remained on the queue. a. Enqueue and Dequeue counts reset are for that broker’s uptime. b. Pending

Re: [AMQ] Queue size grows infinitely

2021-10-01 Thread Tim Bain
The fact that pending messages > enqueued messages looks suspicious, so my expectation is that this will turn out to be a bug in the statistics code. But the information I requested may help us to confirm that. Tim On Fri, Oct 1, 2021, 6:23 AM Jean-Baptiste Onofré wrote: > Hi, > > enqueued and

Re: [AMQ] Queue size grows infinitely

2021-10-01 Thread Jean-Baptiste Onofré
Hi, enqueued and dequeued only increase. The main indicator to check is the pending. If pending count is increasing, it means that the queue size grow infinitely. enqueued is the number of produced messages (not necessary still in the queue). So, which value are you referencing ?

Re: [AMQ] Queue size grows infinitely

2021-10-01 Thread Tim Bain
How are you determining the counts you referenced? I'd expect you could get them from the web console or by doing SQL queries against the database, and I'd encourage you to do both and compare the numbers. I'm hoping you'll find that the stats from the web console (which are sourced from the JMX

[AMQ] Queue size grows infinitely

2021-09-29 Thread Balamurugan Seenivasan
Hi, We notice an issue recently in production where the messages in queue size grows disproportionate to the number of messages actually produced. Queue size grows close to 3 million in about 3 days while the actual messages produced are way less than the actual queue size. Here is one