[Wikidata-bugs] [Maniphest] T330655: monitoring: Disk space check can fail to read fuse mounts
jbond created this task. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Recently we had a cloudvirt host that had a fuse mount as follows $ sudo mount | grep /mnt /dev/fuse on /mnt type fuse (rw,nosuid,nodev,relatime,user_id=0,group_id=0) $ sudo lsof /dev/fuse COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME guestmoun 1395696 root3u CHR 10,229 0t0 282 /dev/fuse $ ps -ef | grep guestmoun root 1395696 1 2 Feb23 ?02:37:10 guestmount -a /var/lib/nova/instances/7498566a-c160-4d7d-90eb-03470e5d80f3/disk.1677097630 -i --ro /mnt As nrpe is ran as the nagios user it received `DISK CRITICAL - /mnt is not accessible: Permission denied` error I think we should either skip fuse mounts from this check or update the nagios and nrpe checks so they can run as root. i think im leaning to the former as the better solution as i dont think we need to error if a fuse mount is running out of space but perhaps im missing something TASK DETAIL https://phabricator.wikimedia.org/T330655 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Aklapper, #cloud-services, #observability-alerting, jbond ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T330311: wmde-analytics-minutely.service is no longer running on stat1007
jbond closed this task as "Resolved". jbond claimed this task. jbond added a comment. Summery of the fix - rolled back the change to remove `RemainAfterExit` - run puppet every where to deploy the change - as puppet is run from a timer this hadn'run a cumin job to - manually stop all timer services which had a next value of n/a - manually restart timers units that had a next value of n/a TASK DETAIL https://phabricator.wikimedia.org/T330311 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: ssingh, jbond, Jelto, Michael, Aklapper, Lucas_Werkmeister_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T316103: Migrate WDQS to Java 11
jbond edited projects, added Packaging; removed SRE. Restricted Application added a project: Infrastructure-Foundations. TASK DETAIL https://phabricator.wikimedia.org/T316103 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Addshore, bking, Aklapper, MoritzMuehlenhoff, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Volans, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, joanna_borun, Devnull, Muchiri124, RhinosF1, Legado_Shulgin, ReaperDawn, Davinaclare77, Techguru.pc, Hfbn0, Zppix, Wong128hk, faidon, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T264181: Migrate WDQS to profile::java
jbond edited projects, added Puppet; removed SRE. Restricted Application added a project: Infrastructure-Foundations. TASK DETAIL https://phabricator.wikimedia.org/T264181 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Aklapper, MoritzMuehlenhoff, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Djdungti, merbst, LawExplorer, Volans, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, scfc, Mbch331, joanna_borun, Devnull, Muchiri124, RhinosF1, Legado_Shulgin, ReaperDawn, Davinaclare77, Techguru.pc, Hfbn0, Zppix, Wong128hk, faidon, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T193473: Add HTTPS support to wdqs-internal service
jbond removed a project: SRE. TASK DETAIL https://phabricator.wikimedia.org/T193473 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: bking, Aklapper, Smalyshev, Gehel, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, ET4Eva, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, joanna_borun, Devnull, Muchiri124, RhinosF1, Legado_Shulgin, ReaperDawn, Davinaclare77, Techguru.pc, Hfbn0, Zppix, Wong128hk, faidon, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T222349: Do not rate limit dumps from internal network
jbond edited projects, added netops; removed SRE. Restricted Application added a project: Infrastructure-Foundations. TASK DETAIL https://phabricator.wikimedia.org/T222349 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Hokwelum, Volans, ayounsi, cmooney, EBernhardson, Bstorm, ArielGlenn, Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Ramtin2021, Invadibot, MPhamWMF, dcaro, Devnull, Slst2020, GeminiAgaloos, maantietaja, nskaggs, Raymond_Ndibe, CBogen, ItamarWMDE, Nintendofan885, Akuckartz, Phamhi, Nandana, Namenlos314, skpuneethumar, sietec, Zylc, Giuliamocci, 1978Gage2001, Lahi, Operator873, Gq86, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, JJMC89, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, mys_721tx, Cmjohnson, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, mark, faidon, scfc, Mbch331, bd808, Krenair, akosiaris, fgiunchedi, joanna_borun, Muchiri124, RhinosF1, Legado_Shulgin, ReaperDawn, Davinaclare77, Techguru.pc, Hfbn0, Zppix, Wong128hk, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T315350: Known, Beta cluster Error: 502, Next Hop Connection Failed
jbond closed subtask T315394: Remove two cherry-picked reverts from deployment-puppetmaster04 as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T315350 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: jnuche, jbond, thcipriani, ori, Zabe, ArielGlenn, bking, RhinosF1, Ryasmeen, matmarex, ppelberg, Daimona, TheresNoTime, Aklapper, Hellket777, LisafBia6531, Astuthiodit_1, AWesterinen, 786, TheReadOnly, Biggs657, karapayneWMDE, Invadibot, MPhamWMF, LSobanski, maantietaja, lmata, Juan90264, Alter-paule, Beast1978, CBogen, ItamarWMDE, Un1tY, Akuckartz, Hook696, CptViraj, PatsagornY, Kent7301, joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Namenlos314, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Neuronton, Liudvikas, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Bawolff, Manybubbles, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T315350: Known, Beta cluster Error: 502, Next Hop Connection Failed
jbond added a comment. > Correct, deployment-deploy03 is the beta deployment server. The failures started right after the Puppet changes in deployment-puppetmaster04 Ack i suspect that could be because ori fixed the merge conflicts which brought in a bunch more changes > Yes, sorry, I pasted the wrong URL, the relevant patch was 823209 in labs/private. As far as I can tell, /var/lib/git/labs/private is being maintained manually judging by the commits there, there's even quite a few marked with [LOCAL]. Nevertheless, I don't really know how we handle it normally. My understanding is that only real secrets should be overlaid on top of the private repo and fake/mock secrets should be pulled in from labs/private but im not super familiar with deployment-prep myself so will leave for others to confirm/clarify TASK DETAIL https://phabricator.wikimedia.org/T315350 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: jnuche, jbond, thcipriani, ori, Zabe, ArielGlenn, bking, RhinosF1, Ryasmeen, matmarex, ppelberg, Daimona, TheresNoTime, Aklapper, Hellket777, LisafBia6531, Astuthiodit_1, AWesterinen, 786, TheReadOnly, Biggs657, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, ItamarWMDE, Un1tY, Akuckartz, Hook696, CptViraj, Kent7301, joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Neuronton, Liudvikas, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T315350: Known, Beta cluster Error: 502, Next Hop Connection Failed
jbond added a comment. In T315350#8161180 <https://phabricator.wikimedia.org/T315350#8161180>, @jnuche wrote: > Hi there. JFYI, after the changes early this morning in `deployment-puppetmaster04` Puppet started failing on the beta deployment server: Just to confirm puppet was failing on `deployment-deploy03` not on `deployment-puppetmaster04`? > Aug 17 00:23:40 deployment-deploy03 puppet-agent[13622]: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, secret(): invalid secret scap/phabricator_token (file: /etc/puppet/modules/scap/manifests/master.pp, line: 107, column: 22) on node deployment-deploy03.deployment-prep.eqiad1.wikimedia.cloud > Aug 17 00:53:51 deployment-deploy03 puppet-agent[15700]: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, secret(): invalid secret scap/phabricator_token (file: /etc/puppet/modules/scap/manifests/master.pp, line: 107, column: 22) on node deployment-deploy03.deployment-prep.eqiad1.wikimedia.cloud this should have been fixed by https://gerrit.wikimedia.org/r/c/labs/private/+/823209 > I've cherry-picked https://gerrit.wikimedia.org/r/c/operations/puppet/+/823211/ into `/var/lib/git/labs/private` on `deployment-puppetmaster04` and the agent seems happy again (fingers crossed) This dosn't make much senses, perhaps this is the wrong link? this CR applies to a change to the operation puppet policy not the private repo. however i dont think we should need to cherry pick the private repo change as its already been merged. TASK DETAIL https://phabricator.wikimedia.org/T315350 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: jnuche, jbond, thcipriani, ori, Zabe, ArielGlenn, bking, RhinosF1, Ryasmeen, matmarex, ppelberg, Daimona, TheresNoTime, Aklapper, Hellket777, LisafBia6531, Astuthiodit_1, AWesterinen, 786, TheReadOnly, Biggs657, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, Juan90264, Alter-paule, Beast1978, CBogen, ItamarWMDE, Un1tY, Akuckartz, Hook696, CptViraj, Kent7301, joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Neuronton, Liudvikas, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T303134: Should wdqs LVS checks page
jbond updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T303134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: jbond, Aklapper, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, jijiki, Klaas_Z4us_V, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, elukey, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Addshore, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T303134: Should wdqs LVS checks page
jbond created this task. jbond added projects: Wikidata-Query-Service, Sustainability (Incident Followup). Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION During a recent incident <https://wikitech.wikimedia.org/wiki/Incident_documentation/2022-03-06_wdqs-categories>, We didn't get pagged until the entire service was unavailable, even though there where early warning signs of the issue in icinga. this task is to evaluate if the early alerts shuld have also paged Alerts which started the incident - <+icinga-wm> PROBLEM - LVS wdqs eqiad port 80/tcp - Wikidata Query Service IPv4 #page on wdqs.svc.eqiad.wmnet is CRITICAL: CRITICAL - Socket timeout after 10 seconds https://wikitech.wikimedia.org/wiki/LVS%23Diagnosing_problems Early warning alert --- PROBLEM - PyBal backends health check on lvs1019 is CRITICAL: PYBAL CRITICAL - CRITICAL - wdqs-heavy-queries_: Servers wdqs1013.eqiad.wmnet, wdqs1004.eqiad.wmnet are marked down but pooled: wdqs-ssl_443: Servers wdqs1004.eqiad.wmnet, wdqs1013.eqiad.wmnet are marked down but pooled: wdqs_80: Servers wdqs1004.eqiad.wmnet, wdqs1013.eqiad.wmnet are marked down but pooled https://wikitech.wikimedia.org/wiki/PyBal TASK DETAIL https://phabricator.wikimedia.org/T303134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: jbond, Aklapper, MPhamWMF, CBogen, Namenlos314, jijiki, Klaas_Z4us_V, Gq86, Lucas_Werkmeister_WMDE, EBjune, merbst, elukey, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T285104: Deploy Shellbox instance (shellbox-constraints) for Wikidata constraint regexes
jbond triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T285104 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Addshore, Lucas_Werkmeister_WMDE, Aklapper, Legoktm, Ladsgroup, joanna_borun, Invadibot, Ramtin0071, Devnull, maantietaja, lmata, wkandek, JMeybohm, Muchiri124, Akuckartz, RhinosF1, Legado_Shulgin, ReaperDawn, Nandana, jijiki, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Esc3300, LawExplorer, Zppix, _jensen, rosalieper, Agabi10, Scott_WUaS, Wong128hk, Eevans, abian, Hardikj, Wikidata-bugs, aude, faidon, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, Dzahn ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T284981: SELECT query arriving to wikidatawiki db codfw hosts causing pile ups during schema change
jbond triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T284981 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Ladsgroup, Addshore, Aklapper, Marostegui, joanna_borun, the0001, Invadibot, Ramtin0071, Selby, Devnull, AndreCstr, maantietaja, XeroS_SkalibuR, lmata, Muchiri124, Akuckartz, Adidsone1, WDoranWMF, holger.knust, RhinosF1, EvanProdromou, Legado_Shulgin, DannyS712, ReaperDawn, Nandana, Mirahamira, Phukettaxigroup, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Markhalsey, GoranSMilovanovic, Jayprakash12345, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, _jensen, rosalieper, Agabi10, Scott_WUaS, Pchelolo, Wong128hk, Wikidata-bugs, aude, mark, faidon, Mbch331, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T281267: various weekly and daily dumps run from systemd timers are broken
jbond removed jbond as the assignee of this task. jbond added a project: User-jbond. TASK DETAIL https://phabricator.wikimedia.org/T281267 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Addshore, Tonina_Zhelyazkova_WMDE, WMDE-leszek, JAllemandou, fgiunchedi, jbond, hoo, dcausse, ArielGlenn, Protsack.stephan, joanna_borun, Invadibot, Ramtin0071, Devnull, maantietaja, lmata, Muchiri124, jannee_e, Akuckartz, RhinosF1, Legado_Shulgin, ReaperDawn, Nandana, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, herron, GoranSMilovanovic, Chicocvenancio, Lunewa, Th3d3v1ls, Hfbn0, QZanden, LawExplorer, Zppix, Volans, _jensen, rosalieper, Scott_WUaS, Wong128hk, gnosygnu, Wikidata-bugs, aude, faidon, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps
jbond added a comment. A drafted a couple of changes (see above) which try to add a hiera parameter to control this, not sure if i got everything but i think it should be a good start TASK DETAIL https://phabricator.wikimedia.org/T267927 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, jbond Cc: ayounsi, jbond, Zbyszko, Gehel, Aklapper, dcausse, MPhamWMF, maantietaja, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, CucyNoiD, Nandana, Namenlos314, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps
jbond added a comment. fyi I noticed the following comment in the reload cook book # FIXME: this cookbook is expected to run for weeks, we don't want to disable puppet for that long #but we want to ensure that the various services aren't restarted by puppet along the way. TASK DETAIL https://phabricator.wikimedia.org/T267927 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, jbond Cc: ayounsi, jbond, Zbyszko, Gehel, Aklapper, dcausse, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T267927: Reload wikidata journal from fresh dumps
jbond added a subscriber: ayounsi. jbond added a comment. In T267927#6863396 <https://phabricator.wikimedia.org/T267927#6863396>, @RKemper wrote: > Note: Puppet is still disabled on `wdqs2008` while the reload runs. It occurred to me that I'm not sure if puppet actually **needs** to be disabled during data reloads or if that's just a precaution we've historically taken - any insight here @Gehel? Im not sure what the answer to this is however i think that in general routine maintenance shouldn't require one to disable puppet if possible i think it would be good to implement ayounsi suggestion In T267927#6856302 <https://phabricator.wikimedia.org/T267927#6856302>, @ayounsi wrote: > Thanks, thinking a bit more about it, it might be better to put whatever blocks those reloads in Puppet behind a Hiera option. So puppet can stay enabled while not interfering with those actions. Im not that familure with search but happy to help out on the puppet side of things if i can TASK DETAIL https://phabricator.wikimedia.org/T267927 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, jbond Cc: ayounsi, jbond, Zbyszko, Gehel, Aklapper, dcausse, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T269693: mediawiki_job_wikidata-updateQueryServiceLag failing
jbond triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T269693 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: RLazarus, RKemper, Aklapper, Devnull, lmata, Muchiri124, CBogen, Akuckartz, Legado_Shulgin, Nandana, Namenlos314, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T244753: Migrate WDQS to Debian Buster
jbond triaged this task as "Medium" priority. TASK DETAIL https://phabricator.wikimedia.org/T244753 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Aklapper, MoritzMuehlenhoff, Gehel, darthmon_wmde, Legado_Shulgin, Nandana, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Rxy, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T232006: LDF service does not Vary responses by Content-Type, sending incorrect cached responses to clients
jbond triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T232006 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Lucas_Werkmeister_WMDE, Aklapper, Lexie_23Kr, darthmon_wmde, Legado_Shulgin, DannyS712, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Techguru.pc, Lahi, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, rosalieper, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T217557: Socket timeout on wdqs.svc.eqiad.wmnet
jbond triaged this task as "Normal" priority. TASK DETAIL https://phabricator.wikimedia.org/T217557 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: jbond Cc: Aklapper, Mathew.onipe, Smalyshev, Gehel, alaa_wmde, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, rosalieper, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
