Pintoch created this task. Pintoch added projects: Toolforge, Wikidata. Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION The EditGroups tool <https://tools.wmflabs.org/editgroups/> listens to the EventStream <https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams> for Wikidata edits and stores their metadata in its own SQL database. The listener process is a Python program which runs in Kubernetes. It connects to the SQL database (`s53685__editgroups`) via Django's ORM and performs the ingestion by batches of edits. Over the past few weeks, the listener has started to die a lot more frequently, generally because its SQL connection vanishes: django.db.utils.OperationalError: (2006, 'MySQL server has gone away') (full stack trace available in the corresponding GitHub issue <https://github.com/Wikidata/editgroups/issues/28>). These repeated failures (about one every hour currently) mean that the listener is accumulating lag (currently 7 hours behind). Has labsdb become more unstable recently? Is there any way to prevent these disconnections? Could perhaps the database be moved to a more reliable host? TASK DETAIL https://phabricator.wikimedia.org/T241029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Aklapper, darthmon_wmde, Nandana, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, srodlund, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair
_______________________________________________ Wikidata-bugs mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
