Hello, I too am running into this same problem. I have never had issues with MySQL connections, and usually operate with 550 connections MAX (in my.sql). I upgraded to 5.3, and I started getting a ton of "out of connection" messages. I bumped to 1,000 connections just to try and make it through the day, and we are exceeding that as well! This is a heavily used mailserver (if that wasn't obvious from the numbers), but it has been rock solid for over 2 years. I'm not sure where to go - but hoping progress is being made on this issue.
Bill Bushong From: [email protected] <[email protected]> On Behalf Of Florian Unger Sent: Wednesday, December 1, 2021 01:29 To: [email protected] Subject: Re: [SOGo] PostgreSQL Idle connections from These are the log file entries when sogo runs out of SQL connections: sogo-mailcow_1 | Nov 30 20:53:18 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x5600ee9aa2e0) sogo-mailcow_1 | Nov 30 20:53:18 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 43s, #1, 0x5600edf629c0) : <MySQL4Channel[0x0x5600ee9aa2e0] connection=0x0x5600ef670610> sogo-mailcow_1 | Nov 30 20:53:18 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x5600ee9aa2e0) sogo-mailcow_1 | Nov 30 20:53:18 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 43s, #1, 0x5600edf629c0) : <MySQL4Channel[0x0x5600ee9aa2e0] connection=0x0x5600ef670610> sogo-mailcow_1 | Nov 30 20:53:18 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x5600ee9aa2e0) sogo-mailcow_1 | Nov 30 20:54:17 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: garbage collecting 0 channels. sogo-mailcow_1 | Nov 30 20:54:17 679d32496afb sogod [71]: <0x0x5600edf72180[GCSChannelManager]> DBPOOL: garbage collecting 0 channels. sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for mysql:///var/run/mysqld/mysqld.sock/mailcow/_sogo_static_view sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: keeping channel (age 0s, #1, 0x5600ee456510) : <MySQL4Channel[0x0x5600ee763d70] connection=0x0x5600ef3a8f10> sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x5600ee763d70) sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_user_profile sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb 2021-11-30 20:56:37.496 sogod[67:67] EXCEPTION: <MySQL4CouldNotOpenChannelException: 0x5600eeea0a60> NAME:NoMoreConnections REASON:cannot open a additional connection ! INFO:(null) sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb sogod [67]: 62.63.64.65 "REPORT /SOGo/dav/test.test%40test.de/Calendar/sek_A_test_D_de_3B-60534C80-59-4A5D0F00/ HTTP/1.0" 501 0/188 0.004 - - 0 - 162 sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_folder_info sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb 2021-11-30 20:56:37.578 sogod[67:67] EXCEPTION: <MySQL4CouldNotOpenChannelException: 0x5600ef3a44b0> NAME:NoMoreConnections REASON:cannot open a additional connection ! INFO:(null) sogo-mailcow_1 | Nov 30 20:56:37 679d32496afb sogod [67]: 62.63.64.65 "REPORT /SOGo/dav/test.test%40test.de/Calendar/personal/ HTTP/1.0" 501 0/188 0.002 - - 0 - 162 sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [67]: <0x0x5600edf67520[GCSChannelManager]> DBPOOL: create new DB channel for mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_folder_info sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb 2021-11-30 20:56:39.394 sogod[67:67] EXCEPTION: <MySQL4CouldNotOpenChannelException: 0x5600ee7fc260> NAME:NoMoreConnections REASON:cannot open a additional connection ! INFO:(null) sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [67]: 62.63.64.65 "REPORT /SOGo/dav/test.test%40test.de/Calendar/sek_A_test_D_de_44-5E835E00-7-77A0F280/ HTTP/1.0" 501 0/188 0.002 - - 0 - 162Nov 30 20:56:39 sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x5600ee7b60a0) sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x5600eedb2560) sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: freeing old channel (age 244s, 0x5600eedb2560) sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: create new DB channel for mysql:///var/run/mysqld/mysqld.sock/mailcow/sogo_user_profile sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: keeping channel (age 0s, #1, 0x5600ee083f80) : <MySQL4Channel[0x0x5600ef754960] connection=0x0x5600f2516cf0> sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: freeing old channel (age 244s, 0x5600ee7b60a0) sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x5600ef754960) sogo-mailcow_1 | Nov 30 20:56:39 679d32496afb sogod [63]: <0x0x5600edfb8c60[GCSChannelManager]> DBPOOL: keeping channel (age 0s, #1, 0x5600ee083f80) : <MySQL4Channel[0x0x5600ef754960] connection=0x0x5600f2516cf0> Greetings Florian On 29.11.2021 10:19, Florian Unger (mailto:[email protected]) wrote: I see a similar behaviour after upgrading to SOGO 5.2.0 with MySQL as database. After a few hours of client usage the Mysql database runs out of available connections. Greetings Florian On 26.11.2021 17:48, Francis Lachapelle (mailto:[email protected]) wrote: Cédric I need the debugging entries during a busy period, until you reach the maximum number of connections of your PostgreSQL server. I'm looking at entries such as: - DBPOOL: create new DB channel - DBPOOL: keeping channel - DBPOOL: garbage collecting Thanks, Francis On Nov 26, 2021, at 10:43, Cédric Archambeau <mailto:[email protected]> wrote: Without postgre debug, tell me if you want it : Nov 26 16:26:54 sogod [68388]: 185.215.13.175 "REPORT /mailto:SOGo/dav/[email protected]/Contacts/pg_addressbook_name/ HTTP/1.1" 207 1517/4915 0.064 27386 94% 0 - 16 Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x55bde58f5ad0) Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: keeping channel (age 125s, #2, 0x55bde598c160) : <0x0x55bde58f5ad0[PostgreSQL72Channel]: connection=<0x0x55bde59b8090[PGConnection]: connection=0x0x55bde59b8250>> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: reused cached DB channel! (0x55bde60e3d80) Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: keeping channel (age 41s, #2, 0x55bde5aa1eb0) : <0x0x55bde60e3d80[PostgreSQL72Channel]: connection=<0x0x55bde5f93910[PGConnection]: connection=0x0x55bde5b7e560>> Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: cannot use handle (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook vs postgresql://dbuser:dbpass@localhost:5432/sogo/sogocontacts0012926777a) Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: cannot use handle (postgresql://dbuser:dbpass@localhost:5432/dbname/table_pg_addressbook vs postgresql://dbuser:dbpass@localhost:5432/sogo/sogo_sessions_folder) Nov 26 16:26:54 sogod [68388]: <0x0x55bde5374dc0[GCSChannelManager]> DBPOOL: create new DB channel for postgresql://localhost/dbname/table_pg_addressbook HTH Cédric Archambeau Le 26/11/2021 à 15:45, Francis Lachapelle (mailto:[email protected]) a écrit : Hi Cédric On Nov 26, 2021, at 06:29, Cédric Archambeau mailto:[email protected] wrote: We have a problem with Postgresql connections from SOGo 5.3.0 since few days (last update monday 22 - community version). Or we had it before but didn't see it ;-) Connections stay idle, mainly with an adressbook (PostgreSQL view with right columns) query from Thunderbird dav (with sogo-connector). We're using ubuntu server 20.04 (PostgreSQL 12.9 - no pooler), everything up to date. We configured idle_in_transaction_session_timeout='5min' as workaround, the job is done for most of connections, but not on dav queries (maybe because of the client response?). These dav connections stay, and new ones are created every 30 min. With few clients we reached tuesday the default max amount of connections for Postgresql (100). Never happened in five years of happy use ;-) With [PGDebugEnabled = YES;], no special observation, queries seem to be fine. Restarting SOGo is the only way to clean up everything. Can you enable GCSChannelManagerPoolDebugEnabled and share the log entries? Thanks, Francis -- mailto:[email protected] https://inverse.ca/sogo/lists -- mailto:[email protected] https://inverse.ca/sogo/lists -- ______________________________________________________ Florian Unger Intego GmbH Tel.: +49-9131-61082-121 Henri-Dunant-Straße 8 Fax.: +49-9131-61082-999 D-91058 Erlangen Email: mailto:[email protected] Germany _____________________________________________________ Geschäftsführer: Registergericht: Dr. Peter Plankensteiner Amtsgericht Fürth Dr. Thomas Wagner HRB 7576 -- mailto:[email protected] https://inverse.ca/sogo/lists -- ______________________________________________________ Florian Unger Intego GmbH Tel.: +49-9131-61082-121 Henri-Dunant-Straße 8 Fax.: +49-9131-61082-999 D-91058 Erlangen Email: mailto:[email protected] Germany _____________________________________________________ Geschäftsführer: Registergericht: Dr. Peter Plankensteiner Amtsgericht Fürth Dr. Thomas Wagner HRB 7576 -- mailto:[email protected] https://inverse.ca/sogo/lists -- [email protected] https://inverse.ca/sogo/lists
