I don't *think* it would purely volume related. We have 16.17 deployments
with very large loads running without issue, and we also run 16.17 against
load simulators without issue.
In each case you have to traceback to find the cause of the problem. For
example, a bad SBC which does not fully adhere to the SIP protocol could be
confusing PJSIP, causing timeouts, etc. Our engineers spent a few days
tracing such a problem before we shipped a high volume system to a customer
earlier this year. (I have NOT traced through your logs below, so I'm not
saying that is your problem)
There are some helpful posts here to help you trace, in the archives of this
list. (In fact I see one responding to a question you asked 2 months ago).
Did that yield nothing? (The response was dead on in terms of how to
diagnose). If you share the result of that diagnosis you might get some
helpful answers.
Dave
From: asterisk-users [mailto:asterisk-users-boun...@lists.digium.com] On
Behalf Of Dan Cropp
Sent: Thursday, September 23, 2021 12:59 PM
To: 'asterisk-users@lists.digium.com'
Subject: [asterisk-users] Any thoughts on Asterisk 16.17.0 outputting FRACK
refcount related messages
We have an extremely busy/large customer. They run fine most of the time,
but periodically asterisk will output FRACK refcount related messages. It
doesn't seem to be related to the volume, because it's not breaking during
their peak times.
When this happens, the system becomes unstable and they have to restart to
get things resolved.
To give an idea of the instability, we have seen INVITE/Trying responses in
SIP messaging logs.
We tell Asterisk to answer via AMI, but Asterisk never sends the OK (even 24
seconds later it hasn't sent).
Eventually the other send CANCEL of the call.
We've now captured 4 different days where something like the following
occurs.
1) Is there a good way to tell if this may be fixed in Asterisk 16.20.0
(short of upgrading)?
2) Would this be something I should submit as an asterisk issue?
Unfortunately, site is so busy capturing the debug will be very difficult
(if not impossible) due to amount of data.
[09/23 14:43:45.095] ERROR[34763][C-1d7f] frame.c: Excessive refcount
10 reached on ao2 object 0x5637ed3742b8
[09/23 14:43:45.095] ERROR[34763][C-1d7f] frame.c: FRACK!, Failed
assertion Excessive refcount 10 reached on ao2 object 0x5637ed3742b8 (0)
[09/23 14:43:45.095] ERROR[29830] frame.c: Excessive refcount 10 reached
on ao2 object 0x5637ed3742b8
[09/23 14:43:45.095] ERROR[29832][C-1920] frame.c: Excessive refcount
10 reached on ao2 object 0x5637ed3742b8
[09/23 14:43:45.095] ERROR[29830] frame.c: FRACK!, Failed assertion
Excessive refcount 10 reached on ao2 object 0x5637ed3742b8 (0)
[09/23 14:43:45.095] ERROR[29832][C-1920] frame.c: FRACK!, Failed
assertion Excessive refcount 10 reached on ao2 object 0x5637ed3742b8 (0)
[09/23 14:43:45.095] ERROR[32973] frame.c: Excessive refcount 10 reached
on ao2 object 0x5637ed3742b8
[09/23 14:43:45.095] ERROR[32973] frame.c: FRACK!, Failed assertion
Excessive refcount 10 reached on ao2 object 0x5637ed3742b8 (0)
[09/23 14:43:45.095] ERROR[3248] frame.c: Excessive refcount 10 reached
on ao2 object 0x5637ed3742b8
[09/23 14:43:45.095] ERROR[3248] frame.c: FRACK!, Failed assertion Excessive
refcount 10 reached on ao2 object 0x5637ed3742b8 (0)
[09/23 14:43:45.095] WARNING[2798][C-0093] channel.c: Exceptionally long
queue length queuing to
CBAnn/IS__8b9c6719-ca29-4c1b-ac87-75e8c6fe7074-0062;1
[09/23 14:43:45.095] ERROR[12979] frame.c: Excessive refcount 10 reached
on ao2 object 0x5637ed3742b8
[09/23 14:43:45.095] ERROR[12979] frame.c: FRACK!, Failed assertion
Excessive refcount 10 reached on ao2 object 0x5637ed3742b8 (0)
[09/23 14:43:45.095] WARNING[21123][C-1157] channel.c: Exceptionally
long queue length queuing to
CBAnn/IS__a652155f-b1fb-4c31-83e5-09ffa2107979-10de;1
[09/23 14:43:45.096] ERROR[29830] : Got 8 backtrace records
# 0: /usr/sbin/asterisk(__ao2_ref+0x209) [0x5637ebef1519]
# 1: /usr/sbin/asterisk(ast_frdup+0x1e2) [0x5637ebf96612]
# 2: /usr/sbin/asterisk(ast_bridge_channel_queue_frame+0x61)
[0x5637ebf1cfe1]
# 3: /usr/lib/asterisk/modules/bridge_softmix.so(+0x40af) [0x7fc15362f0af]
# 4: /usr/lib/asterisk/modules/bridge_softmix.so(+0x560a) [0x7fc15363060a]
# 5: /usr/sbin/asterisk(+0x1db41f) [0x5637ec06041f]
# 6: /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7fc1e9ebf6db]
# 7: /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7fc1e93f971f]
[09/23 14:43:45.097] WARNING[36475][C-0172] channel.c: Exceptionally
long voice queue length queuing to
CBAnn/IS__64bc075a-1ba4-4ad8-ba48-f0aea6ca6bab-1ed3;1
[09/23 14:43:45.098] ERROR[12979] : Got 8 backtrace records
# 0: /usr/sbin/asterisk(__ao2_ref+0x209) [0x5637ebef1519]
# 1: /usr/sbin/asterisk(ast_frdup+0x1e2) [0x5637ebf96612]
# 2:
