jcrespo added a comment. To update the latest issues identified:
- As this creates one connection per wiki, it ends up opening 1800 connections to s3 servers (actual measure) - Most of this connections are idle, not doing actual work, which makes them unnecesary, while creating the same issue than a long-running query (running out of available connections, creating large temporary structures that are impossible or very difficult to defragment) - The cron jobs run as wikiadmin, which are on purpose not limited in execution time, so there is no protection against them overflowing a database server - There has been connection exhaustion observed for the past months on several servers, but specially on s3, (see ticket above) this probably has contributed to it - Connections should only take seconds to execute, then disconnect, otherwise, should the server is depooled, or it lags for other reasons, you are working with stale data and blocking other maintenance workflows TASK DETAIL https://phabricator.wikimedia.org/T118162 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jcrespo Cc: jcrespo, gerritbot, daniel, aude, hoo, Lydia_Pintscher, Addshore, Aklapper, Joe, Wikidata-bugs, Mbch331, Krenair _______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
