[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
gerritbot added a comment. Change 572705 **merged** by jenkins-bot: [analytics/wmde/scripts@master] Add Time limit to scripts executed on stat1007 https://gerrit.wikimedia.org/r/572705 TASK DETAIL https://phabricator.wikimedia.org/T243894 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Rosalie_WMDE, gerritbot Cc: Aklapper, elukey, Ladsgroup, Addshore, Beast1978, Un1tY, 4748kitoko, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Akovalyov, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, JAllemandou, terrrydactyl, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
gerritbot added a comment. Change 573211 **merged** by jenkins-bot: [analytics/wmde/scripts@production] Add Time limit to scripts executed on stat1007 https://gerrit.wikimedia.org/r/573211 TASK DETAIL https://phabricator.wikimedia.org/T243894 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Rosalie_WMDE, gerritbot Cc: Aklapper, elukey, Ladsgroup, Addshore, Beast1978, Un1tY, 4748kitoko, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Akovalyov, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, JAllemandou, terrrydactyl, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
gerritbot added a comment. Change 573211 had a related patch set uploaded (by Addshore; owner: Rosalie Perside (WMDE)): [analytics/wmde/scripts@production] Add Time limit to scripts executed on stat1007 https://gerrit.wikimedia.org/r/573211 TASK DETAIL https://phabricator.wikimedia.org/T243894 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Rosalie_WMDE, gerritbot Cc: Aklapper, elukey, Ladsgroup, Addshore, Beast1978, Un1tY, 4748kitoko, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, alaa_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Akovalyov, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, JAllemandou, terrrydactyl, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
gerritbot added a comment. Change 572705 had a related patch set uploaded (by Rosalie Perside (WMDE); owner: Rosalie Perside (WMDE)): [analytics/wmde/scripts@master] Add Time limit to scripts executed on stat1007 https://gerrit.wikimedia.org/r/572705 TASK DETAIL https://phabricator.wikimedia.org/T243894 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Rosalie_WMDE, gerritbot Cc: Aklapper, elukey, Ladsgroup, Addshore, 4748kitoko, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Akovalyov, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, JAllemandou, terrrydactyl, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
Rosalie_WMDE added a comment. https://github.com/wikimedia/analytics-wmde-scripts/pull/1 TASK DETAIL https://phabricator.wikimedia.org/T243894 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Rosalie_WMDE Cc: Marostegui, Aklapper, elukey, Ladsgroup, Addshore, 4748kitoko, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Akovalyov, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, JAllemandou, terrrydactyl, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
Ladsgroup added a comment. On daily ones: 2020-02-11 03:00:01 wikidata-sparql-instanceof Script Started! 2020-02-11 03:00:01 wikidata-phabricatorTasks Script Started! 2020-02-11 03:00:01 wikidata-site_stats-lexemes Script Started! 2020-02-11 03:00:01 wikidata-site_stats-active_users Script Started! 2020-02-11 03:00:01 wikidata-entityUsage Script Started! 2020-02-11 03:00:01 wikidata-datamodel-properties_by_datatype Script Started! 2020-02-11 03:00:01 wikibase-dockerStats Script Started! 2020-02-11 03:00:01 wikibase-dockerStats Running for: wikibase/wikibase 2020-02-11 03:00:01 wikidata-showcaseItems Script Started! 2020-02-11 03:00:01 wikidata-sparql-ranks Script Started! 2020-02-11 03:00:01 wikidata-site_stats-total_pages Script Started! 2020-02-11 03:00:01 wikidata-datamodel-statements_per_entity Script Started! 2020-02-11 03:00:01 wikidata-dumpDownloads Script Started! 2020-02-11 03:00:01 wikidata-dumpDownloads Targeting date: 07/Feb/2020 2020-02-11 03:00:01 wikidata-social-twitter Script Started! 2020-02-11 03:00:01 wikidata-social-newsletter Script Started! 2020-02-11 03:00:01 betafeature-counts Script Started! 2020-02-11 03:00:01 wikidata-social-irc Script Started! 2020-02-11 03:00:01 wikidata-datamodel-sitelinks_per_site Script Started! 2020-02-11 03:00:01 wikidata-site_stats-total_edits Script Started! 2020-02-11 03:00:01 wikidata-site_stats-pages_by_namespace Script Started! 2020-02-11 03:00:01 wikidata-site_stats-page_size Script Started! 2020-02-11 03:00:01 rollbackconf-userprops Script Started! 2020-02-11 03:00:01 wikidata-social-techmail Script Started! 2020-02-11 03:00:01 advancedsearch-userprops Script Started! 2020-02-11 03:00:01 wikidata-site_stats-recent_changes_by_namespace Script Started! 2020-02-11 03:00:01 wikidata-site_stats-user_languages Script Started! 2020-02-11 03:00:01 wikidata-dumpScanProcessing Script Started! 2020-02-11 03:00:01 wikidata-sparql-constraint-snaks Script Started! 2020-02-11 03:00:01 wikidata-datamodel-sitelinks_per_item Script Started! 2020-02-11 03:00:01 wikidata-site_stats-good_articles Script Started! 2020-02-11 03:00:01 wikidata-dumpScanProcessing File not found: /srv/analytics-wmde/graphite/data/dumpfiles/metrics.json 2020-02-11 03:00:01 wikidata-site_stats-users Script Started! 2020-02-11 03:00:01 wikidata-social-identica Script Started! 2020-02-11 03:00:01 wikidata-site_stats-user_groups Script Started! 2020-02-11 03:00:01 wikidata-social-mail Script Started! 2020-02-11 03:00:01 revslider-userprops Script Started! 2020-02-11 03:00:01 wikidata-site_stats-pagelinks_to_namespaces Script Started! 2020-02-11 03:00:01 catwatch-userprops Script Started! 2020-02-11 03:00:01 wikidata-site_stats-rolling_rc Script Started! 2020-02-11 03:00:01 echo-statusNotifications Script Started! 2020-02-11 03:00:01 wikidata-social-facebook Script Started! 2020-02-11 03:00:01 wikidata-social-irc Script Finished! 2020-02-11 03:00:01 wikidata-site_stats-users Script Finished! 2020-02-11 03:00:01 wikidata-site_stats-total_pages Script Finished! 2020-02-11 03:00:01 wikidata-social-newsletter Script Finished! 2020-02-11 03:00:01 wikidata-showcaseItems Script Finished! 2020-02-11 03:00:01 wikidata-site_stats-user_groups Running query for admins group 2020-02-11 03:00:01 wikidata-site_stats-user_groups Running query for bureaucrats group 2020-02-11 03:00:01 wikidata-site_stats-good_articles Script Finished! 2020-02-11 03:00:01 wikidata-site_stats-user_groups Running query for bots group 2020-02-11 03:00:01 wikidata-site_stats-user_groups Running query for propertycreators group 2020-02-11 03:00:01 wikidata-site_stats-total_edits Script Finished! 2020-02-11 03:00:01 wikidata-site_stats-user_groups Script Finished! 2020-02-11 03:00:01 wikibase-dockerStats Sending data for: wikibase/wikibase 2020-02-11 03:00:01 wikidata-social-techmail Script Finished! 2020-02-11 03:00:01 wikibase-dockerStats Running for: wikibase/wdqs 2020-02-11 03:00:01 wikidata-datamodel-properties_by_datatype Script Finished! 2020-02-11 03:00:01 wikidata-social-mail Script Finished! 2020-02-11 03:00:01 wikibase-dockerStats Sending data for: wikibase/wdqs 2020-02-11 03:00:01 wikibase-dockerStats Running for: wikibase/wdqs-frontend 2020-02-11 03:00:01 wikibase-dockerStats Sending data for: wikibase/wdqs-frontend 2020-02-11 03:00:01 wikibase-dockerStats Running for: wikibase/wdqs-proxy 2020-02-11 03:00:01 wikidata-dumpDownloads Script Finished! 2020-02-11 03:00:01 wikibase-dockerStats Sending data for: wikibase/wdqs-proxy 2020-02-11 03:00:01 wikibase-dockerStats Script Finished! 2020-02-11 03:00:02 wikidata-social-facebook Script Finished! 2020-02-11 03:00:03 wikidata-sparql-constraint-snaks Script Finished! 2020-02-11 03:00:03
[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
Ladsgroup added a comment. So this is for weekly runs: ladsgroup@stat1007:/srv/analytics-wmde/graphite/log$ tail weekly.log-20200217 --lines 500 + '[' -z /srv/analytics-wmde/graphite/src/scripts ']' + date '+%F %T weekly.sh Started!' 2020-02-16 01:00:01 weekly.sh Started! + date '+%F %T weekly.sh Waiting!' + eval /srv/analytics-wmde/graphite/src/scripts/src/dbtables/slots.php ++ /srv/analytics-wmde/graphite/src/scripts/src/dbtables/slots.php 2020-02-16 01:00:01 weekly.sh Waiting! + wait 2020-02-16 01:00:01 dbtables-slots Script Started! 2020-02-16 01:00:01 dbtables-slots Slots DB query failed for # NOTE: This file is automatically generated. Do not try to edit it directly., Skipping!! + date '+%F %T weekly.sh Ended!' 2020-02-16 01:20:56 weekly.sh Ended! 0.07user 0.01system 20:54.94elapsed 0%CPU (0avgtext+0avgdata 27752maxresident)k 16inputs+32outputs (0major+5099minor)pagefaults 0swaps TASK DETAIL https://phabricator.wikimedia.org/T243894 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Rosalie_WMDE, Ladsgroup Cc: Marostegui, Aklapper, elukey, Ladsgroup, Addshore, 4748kitoko, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Akovalyov, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, JAllemandou, terrrydactyl, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T243894: Add time limits to scripts executed on stat1007 as part of analytics/wmde/scripts
Ladsgroup added a comment. Maybe we can have a general timeout using `timeout` bash command instead. Something like `$timeout 3600 php foo.php &`? TASK DETAIL https://phabricator.wikimedia.org/T243894 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup Cc: Marostegui, Aklapper, elukey, Ladsgroup, Addshore, 4748kitoko, Iflorez, darthmon_wmde, alaa_wmde, Nandana, Akovalyov, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, JAllemandou, terrrydactyl, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, jeremyb ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
