[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-23 Thread jbond
jbond closed this task as "Resolved". jbond claimed this task. jbond added a comment. Summery of the fix - rolled back the change to remove `RemainAfterExit` - run puppet every where to deploy the change - as puppet is run from a timer this hadn'run a cumin job to - manually stop

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a subscriber: ssingh. Lucas_Werkmeister_WMDE added a comment. Summary: This indeed seemed to be the problem; @jbond merged the above puppet change, @ssingh manually stopped `wmde-analytics-minutely.service` on stat1007, and the timer started to run it again.

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T330311 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Maintenance_bot Cc: jbond, Jelto, Michael, Aklapper, Lucas_Werkmeister_WMDE, Astuthiodit_1,

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Regarding the `After=` interaction mentioned in the original change: as far as I can tell from some local testing, `After=` works correctly with a `Type=oneshot` unit (i.e. starting the second unit after the first oneshot unit exits) regardless of

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread gerritbot
gerritbot added a comment. Change 891340 **merged** by Jbond: [operations/puppet@production] systemd::timer: unset RemainAfterExit again https://gerrit.wikimedia.org/r/891340 TASK DETAIL https://phabricator.wikimedia.org/T330311 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T330311 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: jbond, Jelto, Michael, Aklapper, Lucas_Werkmeister_WMDE, Themindcoder, Adamm71,

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread gerritbot
gerritbot added a comment. Change 891340 had a related patch set uploaded (by Lucas Werkmeister (WMDE); author: Lucas Werkmeister (WMDE)): [operations/puppet@production] systemd::timer: unset RemainAfterExit again https://gerrit.wikimedia.org/r/891340 TASK DETAIL

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. systemd.timer(5) (emphasis mine): > Note that in case the unit to activate is already active at the time the timer elapses it is not restarted, but simply left running. There

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Hypothesis: a oneshot remain-after-exit service stays active (albeit exited) indefinitely, so the systemd timer never restarts the service (it’s still active, after all). TASK DETAIL https://phabricator.wikimedia.org/T330311 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Might have been caused by https://gerrit.wikimedia.org/r/c/operations/puppet/+/890843, which added `Type=oneshot` and `RemainAfterExit=yes` to the service unit. TASK DETAIL https://phabricator.wikimedia.org/T330311 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Apparently the systemd unit was touched at the same time: lucaswerkmeister-wmde@stat1007:~$ ls -l /lib/systemd/system/wmde-analytics-minutely.service -r--r--r-- 1 root root 337 Feb 22 14:54 /lib/systemd/system/wmde-analytics-minutely.service

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. For comparison, the daily-early service and timer are “**inactive (dead)**” and “active (**waiting**)”, respectively, rather than the minutely units’ “**active (exited)**” and “active (**running**)”. lucaswerkmeister-wmde@stat1007:~$ systemctl

[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007

2023-02-22 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created this task. Lucas_Werkmeister_WMDE added projects: Wikidata, Wikidata Analytics. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Several panels of the Wikidata Alerts