[Wikidata-bugs] [Maniphest] T338488: Quickstatement returning 504 Gateway Time-out
bd808 closed this task as "Resolved". bd808 claimed this task. bd808 added a comment. Restricted Application added a project: User-bd808. Restarting the pod seems to have fixed it. TASK DETAIL https://phabricator.wikimedia.org/T338488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, pere_prlpz, Bellucii32, Astuthiodit_1, karapayneWMDE, Invadibot, Devnull, maantietaja, ItamarWMDE, Nintendofan885, Akuckartz, Nandana, Namenlos314, skpuneethumar, Zylc, 1978Gage2001, Lahi, Operator873, Gq86, Bsandipan, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T332953: Migrate PipelineLib repos to GitLab
bd808 updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T332953 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: odimitrijevic, BTullis, Ottomata, calbon, fgiunchedi, WMDE-leszek, leila, fkaelin, ItamarWMDE, elukey, KartikMistry, santhosh, Martaannaj, sbassett, bking, bd808, Ladsgroup, Krinkle, Legoktm, tstarling, Physikerwelt, dcausse, Jdrewniak, taavi, hnowlan, Michaelcochez, cjming, Jdforrester-WMF, dduvall, Aklapper, thcipriani, Bellucii32, Itsmeduncan, Cleo_Lemoisson, Astuthiodit_1, EChetty, TheReadOnly, karapayneWMDE, toberto, joanna_borun, Simonmaignan, Invadibot, MPhamWMF, Devnull, maantietaja, Muchiri124, Confetti68, Anerka, CBogen, Nintendofan885, Akuckartz, Otr500, WDoranWMF, Ddurigon, MJL, brennen, Mateo1977, EvanProdromou, Legado_Shulgin, ReaperDawn, Nandana, NebulousIris, Namenlos314, aezell, skpuneethumar, Zylc, Davinaclare77, Abdeaitali, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Xinbenlv, Vacio, Sharvaniharan, Bsandipan, scblr, Xover, GoranSMilovanovic, SPoore, TBolliger, Chicocvenancio, Hfbn0, QZanden, EBjune, Tbscho, Taquo, LawExplorer, catalandres, Eginhard, Zppix, JJMC89, TerraCodes, DDJJ, _jensen, rosalieper, Agabi10, PEarleyWMF, RuyP, Liudvikas, Scott_WUaS, Pchelolo, Karthik_sripal, Izno, Wong128hk, Luke081515, Bsadowski1, Niharika, Wikidata-bugs, Jitrixis, aude, Bawolff, Dbrant, Dinoguy1000, Gryllida, Lydia_Pintscher, faidon, Grunny, ssastry, scfc, Alchimista, Arlolra, csteipp, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T332953: Migrate PipelineLib repos to GitLab
bd808 added a comment. The main thing I can think of being a potential blocker for #toolhub <https://phabricator.wikimedia.org/tag/toolhub/> and #wikimedia-developer-portal <https://phabricator.wikimedia.org/tag/wikimedia-developer-portal/> moving would be translatewiki.net integration. Has anyone worked with the TWN folks to get them setup to push changes back to gitlab.wikimedia.org repos yet? TASK DETAIL https://phabricator.wikimedia.org/T332953 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Ladsgroup, Krinkle, Legoktm, tstarling, Physikerwelt, dcausse, Jdrewniak, taavi, hnowlan, Michaelcochez, cjming, Jdforrester-WMF, dduvall, Aklapper, thcipriani, Bellucii32, Mohamed-Awnallah, Itsmeduncan, Cleo_Lemoisson, Astuthiodit_1, lbowmaker, TheReadOnly, BTullis, karapayneWMDE, toberto, joanna_borun, Simonmaignan, Invadibot, MPhamWMF, Ywats0ns, Devnull, maantietaja, calbon, Muchiri124, Confetti68, Anerka, CBogen, ItamarWMDE, Nintendofan885, Akuckartz, Otr500, WDoranWMF, Ddurigon, MJL, brennen, Mateo1977, EvanProdromou, Legado_Shulgin, ReaperDawn, Nandana, NebulousIris, sbassett, Namenlos314, aezell, skpuneethumar, Zylc, Davinaclare77, Abdeaitali, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Xinbenlv, Vacio, Sharvaniharan, Bsandipan, scblr, Xover, GoranSMilovanovic, SPoore, TBolliger, Chicocvenancio, Hfbn0, QZanden, EBjune, Tbscho, Taquo, LawExplorer, catalandres, Eginhard, Avner, Zppix, JJMC89, elukey, TerraCodes, DDJJ, _jensen, rosalieper, Agabi10, PEarleyWMF, RuyP, Liudvikas, Scott_WUaS, Pchelolo, Karthik_sripal, Izno, Wong128hk, Luke081515, Bsadowski1, Niharika, Wikidata-bugs, Jitrixis, aude, Bawolff, Capt_Swing, Dbrant, Dinoguy1000, Gryllida, Lydia_Pintscher, faidon, Grunny, ssastry, scfc, Alchimista, Arlolra, csteipp, Mbch331, Jay8g, Krenair, fgiunchedi ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T332953: Migrate PipelineLib repos to GitLab
bd808 updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T332953 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Ladsgroup, Krinkle, Legoktm, tstarling, Physikerwelt, dcausse, Jdrewniak, taavi, hnowlan, Michaelcochez, cjming, Jdforrester-WMF, dduvall, Aklapper, thcipriani, Bellucii32, Mohamed-Awnallah, Itsmeduncan, Cleo_Lemoisson, Astuthiodit_1, lbowmaker, TheReadOnly, BTullis, karapayneWMDE, toberto, joanna_borun, Simonmaignan, Invadibot, MPhamWMF, Ywats0ns, Devnull, maantietaja, calbon, Muchiri124, Confetti68, Anerka, CBogen, ItamarWMDE, Nintendofan885, Akuckartz, Otr500, WDoranWMF, Ddurigon, MJL, brennen, Mateo1977, EvanProdromou, Legado_Shulgin, ReaperDawn, Nandana, NebulousIris, sbassett, Namenlos314, aezell, skpuneethumar, Zylc, Davinaclare77, Abdeaitali, 1978Gage2001, Techguru.pc, Lahi, Operator873, Gq86, Xinbenlv, Vacio, Sharvaniharan, Bsandipan, scblr, Xover, GoranSMilovanovic, SPoore, TBolliger, Chicocvenancio, Hfbn0, QZanden, EBjune, Tbscho, Taquo, LawExplorer, catalandres, Eginhard, Avner, Zppix, JJMC89, elukey, TerraCodes, DDJJ, _jensen, rosalieper, Agabi10, PEarleyWMF, RuyP, Liudvikas, Scott_WUaS, Pchelolo, Karthik_sripal, Izno, Wong128hk, Luke081515, Bsadowski1, Niharika, Wikidata-bugs, Jitrixis, aude, Bawolff, Capt_Swing, Dbrant, Dinoguy1000, Gryllida, Lydia_Pintscher, faidon, Grunny, ssastry, scfc, Alchimista, Arlolra, csteipp, Mbch331, Jay8g, Krenair, fgiunchedi ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T333072: create a Mix'n'Match catalog for Toolhub entries
bd808 added a comment. This could be a fun little #wikimedia-hackathon-2023 <https://phabricator.wikimedia.org/tag/wikimedia-hackathon-2023/> project for someone. I would be more than happy to help anyone who wanted to pick this up work with the Toolhub side of things. I think we would be able to find others to help with the Mix'n'Match side if we had problems there. TASK DETAIL https://phabricator.wikimedia.org/T333072 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, Lydia_Pintscher, Bellucii32, Astuthiodit_1, karapayneWMDE, Invadibot, Devnull, maantietaja, ItamarWMDE, Akuckartz, Nandana, Namenlos314, skpuneethumar, Zylc, 1978Gage2001, Lahi, Operator873, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T333072: create a Mix'n'Match catalog for Toolhub entries
bd808 added a comment. Based on the info at https://meta.wikimedia.org/wiki/Mix%27n%27match/Import, I think that making a new Toolforge tool that periodically generates a TSV data file from the output of https://toolhub.wikimedia.org/api/tools/ would be reasonable. The tool could store that file in `$HOME/www/static/toolhub.tsv` and Mix'n'Match could read it from `https://tools-static.wmflabs.org//toolhub.tsv`. | TSV column| Toolinfo property| Example | | - | | | | `id` | name | wikimedia-toolhub | | `name`| title| Toolhub | | `description` | description | Toolhub provides both an API and a user interface for documenting and browsing a community curated collection of information about tools used by the Wikimedia movement. | | `q` | annotations.wikidata_qid | Q80474554 | | `P31` | `Q63213147` | Q63213147 | TASK DETAIL https://phabricator.wikimedia.org/T333072 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, Lydia_Pintscher, Bellucii32, Astuthiodit_1, karapayneWMDE, Invadibot, Devnull, maantietaja, ItamarWMDE, Akuckartz, Nandana, Namenlos314, skpuneethumar, Zylc, 1978Gage2001, Lahi, Operator873, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T240340: Host bridge storybook on doc.wikimedia.org
bd808 closed subtask T245026: Archive/delete tool wikibase-databridge-storybook as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T240340 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael, bd808 Cc: Lucas_Werkmeister_WMDE, WMDE-leszek, Pablo-WMDE, Addshore, Aklapper, Michael, Invadibot, Lectrician1, maantietaja, Akuckartz, apaskulin, Nandana, Cpaulf30, Lahi, Gq86, GoranSMilovanovic, Ivana_Isadora, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Dinoguy1000, Lydia_Pintscher, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T240340: Host bridge storybook on doc.wikimedia.org
bd808 changed the status of subtask T245026: Archive/delete tool wikibase-databridge-storybook from Open to In Progress. TASK DETAIL https://phabricator.wikimedia.org/T240340 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael, bd808 Cc: Lucas_Werkmeister_WMDE, WMDE-leszek, Pablo-WMDE, Addshore, Aklapper, Michael, Invadibot, Lectrician1, maantietaja, Akuckartz, apaskulin, Nandana, Cpaulf30, Lahi, Gq86, GoranSMilovanovic, Ivana_Isadora, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Dinoguy1000, Lydia_Pintscher, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T291168: [Debian bullseye image] APT source-list file is not up to date
bd808 added a comment. In T292540#7414548 <https://phabricator.wikimedia.org/T292540#7414548>, @RhinosF1 wrote: > rOPUP96a3cc3f6899: Adapt name of security suite for bullseye and later <https://phabricator.wikimedia.org/rOPUP96a3cc3f689919a1f7034ab7cbc80a3f7f794331> was the production fix TASK DETAIL https://phabricator.wikimedia.org/T291168 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Andrew, RhinosF1, fgiunchedi, Aklapper, Hjfocs, Ramtin2021, Invadibot, dcaro, Devnull, GeminiAgaloos, maantietaja, nskaggs, Raymond_Ndibe, Nintendofan885, Akuckartz, Phamhi, Ettorerizza, Nandana, JKSTNK, skpuneethumar, Fheredia, sietec, Zylc, 1978Gage2001, Lahi, Operator873, Gq86, Bsandipan, GoranSMilovanovic, DSquirrelGM, Jayprakash12345, Chicocvenancio, Allthingsgo, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T291168: [Debian bullseye image] APT source-list file is not up to date
bd808 triaged this task as "High" priority. bd808 added a comment. Bullseye instances are not getting security patches via auto-update as a result of this. TASK DETAIL https://phabricator.wikimedia.org/T291168 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Andrew, RhinosF1, fgiunchedi, Aklapper, Hjfocs, Ramtin2021, Invadibot, dcaro, Devnull, GeminiAgaloos, maantietaja, nskaggs, Raymond_Ndibe, Nintendofan885, Akuckartz, Phamhi, Ettorerizza, Nandana, JKSTNK, skpuneethumar, Fheredia, sietec, Zylc, 1978Gage2001, Lahi, Operator873, Gq86, Bsandipan, GoranSMilovanovic, DSquirrelGM, Jayprakash12345, Chicocvenancio, Allthingsgo, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T277362: Deprecation warning client-repo wikitext link
bd808 updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T277362 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: RhinosF1, brennen, Lucas_Werkmeister_WMDE, Ladsgroup, Addshore, hoo, daniel, WMDE-leszek, toan, Aklapper, maantietaja, Akuckartz, Iflorez, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, abian, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, AMooney ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached
bd808 added a comment. In T257405#6505154 <https://phabricator.wikimedia.org/T257405#6505154>, @Pintoch wrote: > To restart the service, a single command is needed: `webservice --backend kubernetes python3.7 restart`. It is very simple! Here's a way to make it even a bit easier: create a $HOME/service.template file <https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web#Webservice_templates> with your default settings in it and then just type `webservice [start|stop|restart]` as needed. name=$HOME/service.template backend: kubernetes type: python3.7 TASK DETAIL https://phabricator.wikimedia.org/T257405 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Bstorm, Thadguidry, Lydia_Pintscher, Nemo_bis, Nintendofan885, bd808, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS
bd808 closed subtask T257336: Request increased quota for wikidata-query Cloud VPS project as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Smalyshev, Ramsey-WMF, Cparle, MarkTraceur, Abit, Jheald, EBernhardson, dcausse, Lucas_Werkmeister_WMDE, Tpt, Marsupium, Abbe98, Tnegrin, Multichill, Tagishsimon, Husky, Jarekt, Fuzheado, Spinster, Jane023, Keegan, Gamaliel, CBogen, David_Haskiya_WMSE, Nuria, Lea_Lacroix_WMDE, Aklapper, Gehel, NavinRizwi, Akuckartz, darthmon_wmde, DannyS712, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Dinoguy1000, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 closed this task as "Resolved". bd808 added a comment. https://openstack-browser.toolforge.org/server/wcqs-beta-01.wikidata-query.eqiad.wmflabs is using the flavor and scheduled on one of the right hypervisors. Per @andrew in T257336#6290999 <https://phabricator.wikimedia.org/T257336#6290999>, you will not be able to make the other 2 instances until we push existing instances off of cloudvirt-wdqs1001 and cloudvirt-wdqs1003. TASK DETAIL https://phabricator.wikimedia.org/T257336 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Andrew, bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 added a comment. In T257336#6290489 <https://phabricator.wikimedia.org/T257336#6290489>, @bd808 wrote: > hmmm... the flavor is marked with the expected host aggregate as well. This came after the flavor change that @andrew documented in T257336#6290470 <https://phabricator.wikimedia.org/T257336#6290470> TASK DETAIL https://phabricator.wikimedia.org/T257336 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Andrew, bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 added a comment. hmmm... the flavor is marked with the expected host aggregate as well. $ sudo wmcs-openstack flavor show t206636 +++ | Field | Value | +++ | OS-FLV-DISABLED:disabled | False | | OS-FLV-EXT-DATA:ephemeral | 0 | | access_project_ids | wikidata-query | | disk | 3481 | | id | 148d82bc-dc07-481c-b717-ae0b4d78417c | | name | t206636| | os-flavor-access:is_public | False | | properties | aggregate_instance_extra_specs:wdqs='true' | | ram| 135168 | | rxtx_factor| 1.0| | swap || | vcpus | 32 | +++ So how did the instance end up on cloudvirt1024 which is actually marked as 'spare' currently? Maybe there is some regression from the Rocky upgrades? @Andrew I think I need your help. :) TASK DETAIL https://phabricator.wikimedia.org/T257336 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Andrew, bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 added a comment. The hypervisors are marked with the expected host aggregates +--++ | Field| Value | +--++ | aggregates | ['wdqs'] | | service_host | cloudvirt-wdqs1001 | +--++ +--++ | Field| Value | +--++ | aggregates | ['wdqs'] | | service_host | cloudvirt-wdqs1003 | +--++ +--++ | Field| Value | +--++ | aggregates | ['wdqs'] | | service_host | cloudvirt-wdqs1002 | +--++ TASK DETAIL https://phabricator.wikimedia.org/T257336 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 added a comment. After the quota bump @EBernhardson was able to create a new instance using the custom t206636 flavor, but it was scheduled on cloudvirt1024 rather than on one of the cloudvirt-wdqs* hypervisors so we need to fix something about how this works via Horizon. It seems likely that we need to tweak something about the flavor to make the scheduler know where the instances belong. TASK DETAIL https://phabricator.wikimedia.org/T257336 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 added a comment. Quota bumped. $ sudo wmcs-openstack quota show wikidata-query +--++ | Field| Value | +--++ | cores| 17 | | fixed-ips| -1 | | floating-ips | 1 | | health_monitors | None | | injected-file-size | 10240 | | injected-files | 5 | | injected-path-size | 255| | instances| 8 | | key-pairs| 100| | l7_policies | None | | listeners| None | | load_balancers | None | | location | None | | name | None | | networks | 100| | pools| None | | ports| 500| | project | wikidata-query | | project_name | wikidata-query | | properties | 128| | ram | 51200 | | rbac_policies| 10 | | routers | 10 | | secgroup-rules | 100| | secgroups| 40 | | server-group-members | 10 | | server-groups| 10 | | subnet_pools | -1 | | subnets | 100| +--++ $ sudo wmcs-openstack quota set --ram 186368 --cores 64 wikidata-query $ sudo wmcs-openstack quota show wikidata-query +--++ | Field| Value | +--++ | cores| 64 | | fixed-ips| -1 | | floating-ips | 1 | | health_monitors | None | | injected-file-size | 10240 | | injected-files | 5 | | injected-path-size | 255| | instances| 8 | | key-pairs| 100| | l7_policies | None | | listeners| None | | load_balancers | None | | location | None | | name | None | | networks | 100| | pools| None | | ports| 500| | project | wikidata-query | | project_name | wikidata-query | | properties | 128| | ram | 186368 | | rbac_policies| 10 | | routers | 10 | | secgroup-rules | 100| | secgroups| 40 | | server-group-members | 10 | | server-groups| 10 | | subnet_pools | -1 | | subnets | 100| +--++ TASK DETAIL https://phabricator.wikimedia.org/T257336 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 moved this task from Inbox to Approved on the Cloud-VPS (Quota-requests) board. bd808 claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T257336 WORKBOARD https://phabricator.wikimedia.org/project/board/2880/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T257336: Request increased quota for wikidata-query Cloud VPS project
bd808 added a project: cloud-services-team (Kanban). bd808 added a comment. +1 to just do this now. The real quota for this project is their dedicated hardware. TASK DETAIL https://phabricator.wikimedia.org/T257336 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, RKemper, dcausse, EBernhardson, CBogen, Nintendofan885, Akuckartz, Phamhi, darthmon_wmde, ET4Eva, Nandana, JKSTNK, Namenlos314, skpuneethumar, Fheredia, sietec, Jony, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Darkminds3113, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, Tbscho, merbst, LawExplorer, Avner, JJMC89, Gehel, _jensen, rosalieper, Scott_WUaS, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, Jitrixis, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T257365: https://docker-registry.toolforge.org/ CORS error message with Firefox 77.0.1
bd808 removed a subscriber: Tools. bd808 added a comment. It is quite possible that this is being caused by something in my local Firefox setup. TASK DETAIL https://phabricator.wikimedia.org/T257365 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Aklapper, bd808, Nintendofan885, Phamhi, sietec, Zylc, Bstorm, 1978Gage2001, DSquirrelGM, Jayprakash12345, Chicocvenancio, Allthingsgo, Tbscho, JJMC89, Jitrixis, Gryllida, scfc, Mbch331, Krenair, #tools ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T257365: https://docker-registry.toolforge.org/ CORS error message with Firefox 77.0.1
bd808 created this task. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION Console error message is `Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://docker-registry.tools.wmflabs.org/v2/_catalog?n=10. (Reason: CORS request did not succeed).` The server seems to be sending the expected `Access-Control-Allow-Origin: *` header. $ curl -H "Origin: https://docker-registry.toolforge.org/; -H "Access-Control-Request-Method: GET" -H "Access-Control-Request-Headers: X-Requested-With" -X OPTIONS --verbose https://docker-registry.tools.wmflabs.org/v2/_catalog?n=10 * Trying 172.16.7.216... * TCP_NODELAY set * Connected to docker-registry.tools.wmflabs.org (172.16.7.216) port 443 (#0) * ALPN, offering h2 * ALPN, offering http/1.1 * Cipher selection: ALL:!EXPORT:!EXPORT40:!EXPORT56:!aNULL:!LOW:!RC4:@STRENGTH * successfully set certificate verify locations: * CAfile: /etc/ssl/certs/ca-certificates.crt CApath: /etc/ssl/certs * TLSv1.2 (OUT), TLS header, Certificate Status (22): * TLSv1.2 (OUT), TLS handshake, Client hello (1): * TLSv1.2 (IN), TLS handshake, Server hello (2): * TLSv1.2 (IN), TLS handshake, Certificate (11): * TLSv1.2 (IN), TLS handshake, Server key exchange (12): * TLSv1.2 (IN), TLS handshake, Server finished (14): * TLSv1.2 (OUT), TLS handshake, Client key exchange (16): * TLSv1.2 (OUT), TLS change cipher, Client hello (1): * TLSv1.2 (OUT), TLS handshake, Finished (20): * TLSv1.2 (IN), TLS change cipher, Client hello (1): * TLSv1.2 (IN), TLS handshake, Finished (20): * SSL connection using TLSv1.2 / ECDHE-RSA-AES256-GCM-SHA384 * ALPN, server accepted to use http/1.1 * Server certificate: * subject: CN=toolforge.org * start date: Jun 22 19:00:15 2020 GMT * expire date: Sep 20 19:00:15 2020 GMT * subjectAltName: host "docker-registry.tools.wmflabs.org" matched cert's "*.tools.wmflabs.org" * issuer: C=US; O=Let's Encrypt; CN=Let's Encrypt Authority X3 * SSL certificate verify ok. > OPTIONS /v2/_catalog?n=10 HTTP/1.1 > Host: docker-registry.tools.wmflabs.org > User-Agent: curl/7.52.1 > Accept: */* > Origin: https://docker-registry.toolforge.org/ > Access-Control-Request-Method: GET > Access-Control-Request-Headers: X-Requested-With > < HTTP/1.1 200 OK < Server: nginx/1.13.6 < Date: Tue, 07 Jul 2020 20:26:08 GMT < Content-Length: 0 < Connection: keep-alive < Allow: GET < Docker-Distribution-Api-Version: registry/2.0 < Docker-Distribution-Api-Version: registry/2.0 < Access-Control-Allow-Origin: * < * Curl_http_done: called premature == 0 * Connection #0 to host docker-registry.tools.wmflabs.org left intact TASK DETAIL https://phabricator.wikimedia.org/T257365 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Aklapper, #tools, PHID-PROJ-7sul7hj32btacinsnubq, bd808 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T257365: https://docker-registry.toolforge.org/ CORS error message with Firefox 77.0.1
bd808 removed a subscriber: cloud-services-team (Kanban). bd808 added projects: Tools, cloud-services-team (Kanban). TASK DETAIL https://phabricator.wikimedia.org/T257365 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Aklapper, #tools, bd808, Nintendofan885, Phamhi, sietec, Zylc, Bstorm, 1978Gage2001, DSquirrelGM, Jayprakash12345, Chicocvenancio, Allthingsgo, Tbscho, JJMC89, Jitrixis, Gryllida, scfc, Mbch331, Krenair, PHID-PROJ-7sul7hj32btacinsnubq ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T199652: Tool 'wp-world' gives 404s
bd808 added a comment. In T199652#6207506 <https://phabricator.wikimedia.org/T199652#6207506>, @Dvorapa wrote: > @bd808 Google now requires to pay for using his Maps externally (i.e. in Toolforge tools), so any solution to the proxy issue would still not help restoring Google Maps tools. But Google provides free access for foundations, who ask for that. Could we somehow on behalf of WMF ask Google (through their provided contact form for these cases) for this access? That is a discussion that could be started. The Partnerships team <https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Partnerships_team> would be the folks we would need to talk with about something like that. I'm not sure I understand well what services from Google Maps that you and other tool maintainers need, so making a separate task or wiki page somewhere to discuss that might be a good way to start. I would hope that we do not need Google to act as a tile server with the combination of the Maps Cloud VPS project and the Foundation maintained tile servers. Tools fetching tiles from outside of those two projects are currently the top blockers to me turning the Content-Security-Policy rules from T130748: Add Content-Security-Policy header enforcing 3rd party web interaction restrictions to proxy responses <https://phabricator.wikimedia.org/T130748> into enforcement mode in support of T133919: [EPIC] Protect end-user privacy by restricting non-consensual third-party browser interactions <https://phabricator.wikimedia.org/T133919>. TASK DETAIL https://phabricator.wikimedia.org/T199652 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Dvorapa, deryckchan, TheDJ, Kolossos, zhuyifei1999, Vincent_Mia_Edie_Verheyen, CBogen, darthmon_wmde, Nandana, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Jayprakash12345, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, Poyekhali, _jensen, rosalieper, Taiwania_Justo, Scott_WUaS, Ixocactus, Wong128hk, Wikidata-bugs, Jitrixis, aude, El_Grafo, Dinoguy1000, Gryllida, scfc, Steinsplitter, Mbch331, Krenair, Keegan ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Paste] [Commented On] P7298: Find tools using `wb_terms`
bd808 added a comment.
Modified version of the script that works on the NFS primary servers
(`labstore100{4,5}.eqiad.wmnet`)
name=find_wb_terms_tools.sh
#!/bin/bash
function check_tool {
if grep \
--quiet \
--no-messages \
--recursive \
--fixed-strings \
--binary-files=without-match \
--include='*.php' \
--include='*.sql' \
--include='*.py' \
--include='*.java' \
--include='*.pl' \
--include='*.bash' \
--include='*.sh' \
--include='*.c' \
--include='*.cxx' \
--include='*.cpp' \
--include='*.cc' \
--include='*.C' \
--include='*.c++' \
wb_terms \
"/srv/tools/shared/tools/project/$1/"
then
printf '%s\n' "$1"
else
status=$?
case $status in
1)
# no match
return 0
;;
2)
printf >&2 'grep error while searching tool %s\n' "$1"
return 2
;;
*)
printf >&2 'unknown grep exit code while searching tool %s:
%d\n' "$1" "$status"
return $status
;;
esac
fi
}
if (($#)); then
for tool; do check_tool "$tool"; done
else
for dir in /srv/tools/shared/tools/project/*; do
tool=${dir##*/}
check_tool "$tool"
done
fi
PASTE DETAIL
https://phabricator.wikimedia.org/P7298
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Lucas_Werkmeister_WMDE, bd808
Cc: bd808, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden,
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude,
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Paste] [Commented On] P7299: Tools using `wb_terms`
bd808 added a comment. I ran a slightly modified version of @Lucas_Werkmeister_WMDE's script from P7298 <https://phabricator.wikimedia.org/P7298> directly on the Toolforge NFS master server on 2020-03-26 to produce the updated list. This list is likely not exhaustive and also may contain false positive matches for some tools by scanning "dead" code. PASTE DETAIL https://phabricator.wikimedia.org/P7299 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE, bd808 Cc: bd808, WMDE-leszek, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Paste] [Updated] P7299: Tools using `wb_terms`
bd808 edited the content of this paste. PASTE DETAIL https://phabricator.wikimedia.org/P7299 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE, bd808 Cc: WMDE-leszek, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T192292: Request to return 405 on POST calls to SPARQL endpoint, Wikidata primary sources tool VPS project
bd808 removed a project: cloud-services-team. TASK DETAIL https://phabricator.wikimedia.org/T192292 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, Hjfocs, Jingbiao95, darthmon_wmde, Legado_Shulgin, 94rain, Nandana, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, Jitrixis, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, sietec, aborrero ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T243950: RDF output of an entity loads all referenced entities, it shouldn't
bd808 updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T243950 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Marostegui, jcrespo, Gehel, Addshore, Aklapper, Agabi10, Ladsgroup, darthmon_wmde, Nandana, Jony, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Vali.matei, _jensen, rosalieper, Scott_WUaS, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Declined] T189747: Toolforge node for constraint reports updating bot
bd808 closed this task as "Declined". bd808 added a comment. Declining per my prior response in T189747#4051897 <https://phabricator.wikimedia.org/T189747#4051897>. A Cloud VPS project could be requested to provide dedicated resources, but there is no dedicated Toolforge "node" option. A Cloud VPS project request is also unlikely to be approved without further details about the source code, its license, and the general value to the Wikidata/Wikibase community of this tool. TASK DETAIL https://phabricator.wikimedia.org/T189747 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Lea_Lacroix_WMDE, Jklamo, Mike_Peel, Ayack, Edgars2007, Lucas_Werkmeister_WMDE, bd808, zhuyifei1999, Multichill, Lydia_Pintscher, #wikibase-quality-constraints, Ivan_A_Krestinin, Aklapper, Phamhi, darthmon_wmde, Nandana, sietec, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, Allthingsgo, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Agabi10, Scott_WUaS, Luke081515, abian, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Assigned] T236574: "wikidata-primary-sources-tool" Cloud VPS project jessie deprecation
bd808 assigned this task to Hjfocs. TASK DETAIL https://phabricator.wikimedia.org/T236574 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Hjfocs, bd808 Cc: Kiailandi, Denny, bd808, Hjfocs, Aklapper, StrikerBot, Jingbiao95, JKSTNK, Fheredia, Jony, Zylc, 1978Gage2001, aborrero, Chicocvenancio, Tbscho, dachary, JJMC89, srodlund, Wikidata-bugs, Jitrixis, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T241890: merge scrambles items in QuickStatement2
bd808 added projects: Tools, Wikidata. bd808 added a subscriber: Magnus. TASK DETAIL https://phabricator.wikimedia.org/T241890 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Magnus, Aklapper, SCIdude, darthmon_wmde, Nandana, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Jayprakash12345, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, srodlund, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Project Column] T236574: "wikidata-primary-sources-tool" Cloud VPS project jessie deprecation
bd808 moved this task from VPS Projects to Additional time needed on the Cloud-VPS (Debian Jessie Deprecation) board. bd808 added a comment. In T236574#5773564 <https://phabricator.wikimedia.org/T236574#5773564>, @Kiailandi wrote: > @Hjfocs won't be able to adress this task until the 9th of January. If it is extremely urgent I could try to fix it. Working on it starting next week would be great! I will mark this project as one needing a bit more time. TASK DETAIL https://phabricator.wikimedia.org/T236574 WORKBOARD https://phabricator.wikimedia.org/project/board/4347/ EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Kiailandi, Denny, bd808, Hjfocs, Aklapper, StrikerBot, Jingbiao95, JKSTNK, Fheredia, Jony, Zylc, 1978Gage2001, aborrero, Chicocvenancio, Tbscho, dachary, JJMC89, srodlund, Wikidata-bugs, Jitrixis, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T236574: "wikidata-primary-sources-tool" Cloud VPS project jessie deprecation
bd808 added a project: Wikidata-primary-sources. bd808 added a subscriber: Denny. bd808 added a comment. @Denny You marked this project as "in use" in the 2019 project purge <https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2019_Purge#In_use_wikidata-primary-sources-tool>. Are you able to contact @Hjfocs to address this task? TASK DETAIL https://phabricator.wikimedia.org/T236574 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Denny, bd808, Hjfocs, Aklapper, StrikerBot, Jingbiao95, JKSTNK, Fheredia, Jony, Zylc, 1978Gage2001, aborrero, Kiailandi, Chicocvenancio, Tbscho, dachary, JJMC89, srodlund, Wikidata-bugs, Jitrixis, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173777: ListeriaBot logs in 28000 times a day
bd808 edited projects, added Tools; removed Cloud-VPS. TASK DETAIL https://phabricator.wikimedia.org/T173777 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Magnus, Aklapper, Cyberpower678, MaxSem, darthmon_wmde, DannyS712, Nandana, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, rosalieper, srodlund, Wikidata-bugs, Jitrixis, aude, Gryllida, scfc, Mbch331, Krenair, JKSTNK, Fheredia, Jony, aborrero, Jay8g ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unassigned] T235413: Access denied to Toolforge DB since last Friday
bd808 removed a project: Wikidata. bd808 removed Criscod as the assignee of this task. TASK DETAIL https://phabricator.wikimedia.org/T235413 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Zoranzoki21, bd808, Base, Aklapper, Criscod, Phamhi, Killertrap, sietec, Jony, Zylc, Giuliamocci, Bstorm, 1978Gage2001, aborrero, Chicocvenancio, Allthingsgo, Tbscho, Freddy2001, JJMC89, srodlund, Luke081515, mys_721tx, Jitrixis, Gryllida, jayvdb, scfc, coren, Krenair, chasemp, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Assigned] T221631: Dedicated servers on WMCS to test WDQS scalability strategy
bd808 assigned this task to Andrew. bd808 edited projects, added cloud-services-team (Kanban); removed cloud-services-team. bd808 added a comment. Assigning to @andrew so he can start the procurement process with DCOps. TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Andrew, bd808 Cc: GreenReaper, RazShuty, Krenair, Smalyshev, Andrew, Gehel, bd808, Aklapper, darthmon_wmde, DannyS712, Nandana, sietec, Bstorm, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, EBjune, merbst, LawExplorer, B20180, _jensen, rosalieper, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221631: Dedicated servers on WMCS to test WDQS scalability strategy
bd808 added a comment. I verified today that we have budget for this build in FY19/20 Q1 (July-September 2019). Before I start a procurement request, @Gehel can you confirm that this test cluster is still desired by the Search team? TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: RazShuty, Krenair, Smalyshev, Andrew, Gehel, bd808, Aklapper, darthmon_wmde, DannyS712, Nandana, sietec, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T230247: Increase VCPU quota for wikidata-query project
bd808 added a comment. #cloud-vps-quota-requests <https://phabricator.wikimedia.org/project/view/2880/> explains the procedure for requesting a quota change for a Cloud VPS project. TASK DETAIL https://phabricator.wikimedia.org/T230247 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Aklapper, Smalyshev, darthmon_wmde, DannyS712, Nandana, JKSTNK, Fheredia, AndyTan, Jony, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, Tbscho, merbst, LawExplorer, JJMC89, _jensen, rosalieper, Cirdan, Jonas, Xmlizer, srodlund, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T227277: shex-simple tool loads various 3rd party resource
bd808 added a parent task: T172065: Hunt for Toolforge tools that load resources from third party sites. TASK DETAIL https://phabricator.wikimedia.org/T227277 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Aklapper, Bugreporter, darthmon_wmde, JFishback_WMF, pdehaye, Michael, Nandana, sbassett, Lahi, Gq86, Andrawaag, GoranSMilovanovic, QZanden, YULdigitalpreservation, LawExplorer, Salgo60, _jensen, rosalieper, MisterSynergy, abian, Wikidata-bugs, aude, Bawolff, Lydia_Pintscher, Slaporte, csteipp, Mbch331, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221631: Dedicated servers on WMCS to test WDQS scalability strategy
bd808 added a comment. In T221631#5131369 <https://phabricator.wikimedia.org/T221631#5131369>, @Gehel wrote: > So my preference would be to have dedicated servers, with a single VM on each, basically using our cloud infrastructure only as an isolation layer. I'm not sure how much sense this makes and we're very much open to suggestions! Yes, it makes sense. We are budgeting for the 3 hosts in Q1 of FY19/20. TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Krenair, Smalyshev, Andrew, Gehel, bd808, Aklapper, alaa_wmde, Nandana, sietec, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221631: Dedicated servers on WMCS to test WDQS scalability strategy
bd808 added a comment. I see 2 ways to approach this: 1. Try to map these requirements into our "standard" cloudvirt hosts and expand our FY2019/2020 planned growth to include the needed expansion 2. Spec and rack specific hardware sized for these instances using the "fake ironic" model of making them virt servers with a single instance each A single cloudvirt identical to cloudvirt10[25-30] would provide all of the CPU and RAM needed for all 3 instances. It would not provide the amount of disk being asked for however (9T usable). We are actively discussing moving instance storage to some shared storage cluster (currently looking into Ceph), but do not currently know how this will work out, how long it will take, etc. It is also very unknown what kind of IOPS this will provide. TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Krenair, Smalyshev, Andrew, Gehel, bd808, Aklapper, alaa_wmde, Nandana, sietec, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T206636: Provide a way to have test servers on real hardware, isolated from production for Wikidata Query Service
bd808 added a subtask: T221631: Dedicated servers on WMCS to test WDQS scalability strategy. TASK DETAIL https://phabricator.wikimedia.org/T206636 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: bd808, Addshore, Andrew, Aklapper, Smalyshev, Gehel, alaa_wmde, Legado_Shulgin, Nandana, thifranc, AndyTan, sietec, Davinaclare77, Bstorm, Qtn1293, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, rosalieper, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T221631: Dedicated servers on WMCS to test WDQS scalability strategy
bd808 added a parent task: T206636: Provide a way to have test servers on real hardware, isolated from production for Wikidata Query Service. TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Krenair, Smalyshev, Andrew, Gehel, bd808, Aklapper, alaa_wmde, Nandana, sietec, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221631: Dedicated servers on WMCS to test WDQS scalability strategy
bd808 added a comment.
In T206636#4941969 <https://phabricator.wikimedia.org/T206636#4941969>,
@bd808 wrote:
> The next step here is to determine the hardware requirements and then find
out if there is current fiscal year budget to cover procuring the required
hardware, or if we can allocate a dedicated server from the existing cloudvirt
pool and backfill that capacity.
>
> The wdqs10{09,10} prod hosts each have 8 cores, 128GB RAM, 4x800GB SSD
(1.6TB RAID10). Our most recent cloudvirt servers (cloudvirt10[25-30]) are 36
physical cores, 512GB RAM, 6x1.92TB SSD (5.7TB RAID10). I think this means that
a single cloudvirt would be more than enough hardware if it was not shared with
other arbitrary workloads.
In T206636#4946372 <https://phabricator.wikimedia.org/T206636#4946372>,
@Smalyshev wrote:
> Yes, judging from our preliminary test, if we get uncontested use of the
server or even a certain chunk of it maybe (not sure if possible?) it would be
enough. Note that an interesting scenario that we want to test in foreseeable
future involves cluster setup, so we'd want at least 2 hosts (not sure whether
they have to be on 2 separate hardware machines) with requirements close to
what wdqs hosts have. It could splitting cloudvirt host into two VMs
exclusively used by these test hosts would be ok. Not sure if virtualization
that we do now allows such kind of fixed resource allocations (probably also
I/O resources need to be taken care of?)
In T206636#4948039 <https://phabricator.wikimedia.org/T206636#4948039>,
@bd808 wrote:
> In T206636#4946372 <https://phabricator.wikimedia.org/T206636#4946372>,
@Smalyshev wrote:
>
> > Not sure if virtualization that we do now allows such kind of fixed
resource allocations (probably also I/O resources need to be taken care of?)
>
>
> We have a few special instances that we do this for today. It is something
that we are experimenting with for virtualization of shared Cloud Services
systems such as the ToolsDB databases. The process that requires cloud-root
assistance to create the initial instances using cli magic, but it is possible.
Basically we mark the cloudvirt as unavailable for selection by the normal
OpenStack scheduler and then force create the desired instances there manually.
TASK DETAIL
https://phabricator.wikimedia.org/T221631
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bd808
Cc: Krenair, Smalyshev, Andrew, Gehel, bd808, Aklapper, alaa_wmde, Nandana,
sietec, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic,
Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper,
Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles,
Mbch331, chasemp
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T221631: Dedicated servers on WMCS to test WDQS scalability strategy
bd808 added a subscriber: Smalyshev. bd808 added a comment. In T221631#5131021 <https://phabricator.wikimedia.org/T221631#5131021>, @Andrew wrote: > Can you tell me more about what these hosts would actually do? Are they virt hosts hosting one big VM each? I think we need to think about this ask from the point of view of virtual instances with the ask being 3 VMs with these specs. The related data point to think about is the testing that @Smalyshev did with help from @andrew this past year where Stas tried out various testing instances for WDQS staging/testing. That was tracked in T206636: Provide a way to have test servers on real hardware, isolated from production for Wikidata Query Service <https://phabricator.wikimedia.org/T206636>, which I think this task is really a continuation of. TASK DETAIL https://phabricator.wikimedia.org/T221631 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: Smalyshev, Andrew, Gehel, bd808, Aklapper, alaa_wmde, Nandana, sietec, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, chasemp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T220046: Set up developer account for Igor Kim
bd808 closed this task as "Resolved". bd808 claimed this task. bd808 added a comment. Account is created (https://wikitech.wikimedia.org/wiki/Special:Log?page=User%3AIgor+Kim) and password has been sent to @Igorkim78. TASK DETAIL https://phabricator.wikimedia.org/T220046 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bd808 Cc: greg, bd808, mmodell, thcipriani, Aklapper, Nuria, Smalyshev, Igorkim78, alaa_wmde, ET4Eva, Nandana, Jony, Lahi, Gq86, Darkminds3113, Tommy_Kronkvist, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, _jensen, rosalieper, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, RobH, aude, Tobias1984, Manybubbles, Jdforrester-WMF, Mbch331, Rxy, Jay8g, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T220046: Set up developer account for Igor Kim
bd808 added a comment.
In T220046#5101834 <https://phabricator.wikimedia.org/T220046#5101834>, @greg
wrote:
> In T220046#5098961 <https://phabricator.wikimedia.org/T220046#5098961>,
@Smalyshev wrote:
>
> > @thcipriani @mmodell is this something you would be able to do - create
the Gerrit account for Igor manually?
>
>
> it needs to be done through wikitech wiki (and thus ldap). cc @bd808
@Igorkim78 please send me an email (bda...@wikimedia.org) with @Smalyshev in
CC providing this information:
- **Desired username**. Developer account usernames are often either the
user's full name (e.g. "Igor Kim") or the name of the user's volunteer
Wikimedia account ("BryanDavis" in my case).
- **Desired unix shell user name**. This can be pretty much anything that
fits the requirements of the regex `/^[a-z]([-a-z0-9]{0,30}[a-z0-9])?$/`.
- **Desired email address**. The primary purpose for this email address will
be to contract you about Cloud VPS/Toolforge issues that may eventually affect
your developer account. It is also used in the gerrit user interface and will
be "public" to anyone who is looking at Gerrit accounts or the LDAP directory
that stores our developer account information.
@Smalyshev when you see that email, please respond to it with a verification
that it matches your expectations of an email coming from @Igorkim78 so I have
some assurance that I'm setting up the account for the correct human. I can
then manually create the developer account and email the initial password back
directly to @Igorkim78.
TASK DETAIL
https://phabricator.wikimedia.org/T220046
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bd808
Cc: greg, bd808, mmodell, thcipriani, Aklapper, Nuria, Smalyshev, Igorkim78,
alaa_wmde, ET4Eva, Nandana, Jony, Lahi, Gq86, Darkminds3113, Tommy_Kronkvist,
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst,
LawExplorer, Avner, Gehel, _jensen, rosalieper, Jonas, FloNight, Xmlizer,
jkroll, Wikidata-bugs, Jdouglas, RobH, aude, Tobias1984, Manybubbles,
Jdforrester-WMF, Mbch331, Rxy, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T216404: deployment-db03.deployment-prep.eqiad.wmflabs instance can not start
bd808 added a parent task: T215217: deployment-prep: Code stewardship request. TASK DETAILhttps://phabricator.wikimedia.org/T216404EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, GTirloni, Addshore, Legoktm, Peachey88, Bawolff, RhinosF1, Andrew, Zoranzoki21, Krenair, MarcoAurelio, hashar, Aklapper, Nandana, JKSTNK, Fheredia, AndyTan, sietec, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Rxy, Jay8g, greg, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unassigned] T216404: deployment-db03.deployment-prep.eqiad.wmflabs instance can not start
bd808 added subscribers: GTirloni, bd808.bd808 removed GTirloni as the assignee of this task.bd808 added a comment. In T216404#4964728, @Addshore wrote: I'm not sure why this is only "Normal", I'm going to at least bump this to high. We are essentially ignoring one of our QA/CI steps here which will increase the chances of incidents in production.. Perhaps this should even be UBN..? Who are you trying to push to move faster? What is the desired outcome of this task? In T216404#4962137, @hashar wrote: The instance is reacheable but the service is not happy: The log sequence numbers 212565209189 and 212565209189 in ibdata files do not match the log sequence number 233682420105 in the ib_logfiles! [ERROR] InnoDB: Tried to read 16384 bytes at offset 0. Was only able to read 0. InnoDB: Operating system error number 5 in a file operation. InnoDB: Error number 5 means 'Input/output error'. Fixing these errors is beyond the core services offered by the Cloud Services team.TASK DETAILhttps://phabricator.wikimedia.org/T216404EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, GTirloni, Addshore, Legoktm, Peachey88, Bawolff, RhinosF1, Andrew, Zoranzoki21, Krenair, MarcoAurelio, hashar, Aklapper, Nandana, JKSTNK, Fheredia, AndyTan, sietec, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Rxy, Jay8g, greg, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production for Wikidata Query Service
bd808 added a comment. In T206636#4946372, @Smalyshev wrote: Not sure if virtualization that we do now allows such kind of fixed resource allocations (probably also I/O resources need to be taken care of?) We have a few special instances that we do this for today. It is something that we are experimenting with for virtualization of shared Cloud Services systems such as the ToolsDB databases. The process that requires cloud-root assistance to create the initial instances using cli magic, but it is possible. Basically we mark the cloudvirt as unavailable for selection by the normal OpenStack scheduler and then force create the desired instances there manually.TASK DETAILhttps://phabricator.wikimedia.org/T206636EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Addshore, Andrew, Aklapper, Smalyshev, Gehel, Legado_Shulgin, Nandana, thifranc, AndyTan, sietec, Davinaclare77, Qtn1293, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T215620: Tool "autodesc" - can't start webservice
bd808 added a comment. In T215620#4942790, @Magnus wrote: So the gridengine says no webservice is running, but kubernetes says it is, and won't start its own. I added a workaround for this to the FAQ on wikitech today after it bit another tool during migration: webservice stop (just to be sure) rm $HOME/service.manifest webservice [other args go here] start TASK DETAILhttps://phabricator.wikimedia.org/T215620EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Sjoerddebruin, SandraF_WMF, Simon_Villeneuve, Framawiki, LucasWerkmeister, Bstorm, bd808, Magnus, Aklapper, Nandana, AndyTan, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206636: Provide a way to have test servers on real hardware, isolated from production for Wikidata Query Service
bd808 added a comment.
The next step here is to determine the hardware requirements and then find out if there is current fiscal year budget to cover procuring the required hardware, or if we can allocate a dedicated server from the existing cloudvirt pool and backfill that capacity.
The wdqs10{09,10} prod hosts each have 8 cores, 128GB RAM, 4x800GB SSD (1.6TB RAID10). Our most recent cloudvirt servers (cloudvirt10[25-30]) are 36 physical cores, 512GB RAM, 6x1.92TB SSD (5.7TB RAID10). I think this means that a single cloudvirt would be more than enough hardware if it was not shared with other arbitrary workloads.TASK DETAILhttps://phabricator.wikimedia.org/T206636EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Addshore, Andrew, Aklapper, Smalyshev, Gehel, Legado_Shulgin, Nandana, thifranc, AndyTan, sietec, Davinaclare77, Qtn1293, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, Jonas, Xmlizer, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T155190: Build an environment to test change dispatching using Redis-based locking
bd808 closed subtask T155196: Vagrant 1.9.1 provision failure on Trusty using role::labs:mediawiki_vagrant as "Declined". TASK DETAILhttps://phabricator.wikimedia.org/T155190EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, bd808Cc: Stashbot, aaron, daniel, Marostegui, jcrespo, Aklapper, Jonas, Lydia_Pintscher, hoo, gerritbot, Ladsgroup, Nandana, Banyek, AndyTan, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, LawExplorer, Vali.matei, Minhnv-2809, _jensen, D3r1ck01, Volker_E, Luke081515, Wikidata-bugs, aude, GWicke, Dinoguy1000, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T209818: Mount dumps NFS share to instances in the soweego VPS project
bd808 renamed this task from "Request to access shared storage on the soweego VPS project" to "Mount dumps NFS share to instances in the soweego VPS project". TASK DETAILhttps://phabricator.wikimedia.org/T209818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aborrero, bd808Cc: bd808, aborrero, Aklapper, Hjfocs, Nandana, JKSTNK, GTirloni, Fheredia, AndyTan, sietec, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, Tbscho, LawExplorer, JJMC89, _jensen, D3r1ck01, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T210679: Make WDQS auto-completion keyboard shortcut configurable
bd808 added a project: Wikidata-Query-Service.Restricted Application added a project: Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T210679EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Tarrow, Addshore, DarTar, Aklapper, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, D3r1ck01, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T208986: WDQS tests can no longer edit test.wikidata.org
bd808 added a comment. I bit more digging has exposed that this is not a wide spread problem for all eqiad1-r users. The part of CommonSettings.php that allows anon edits from the 10.68.0.0/16 is gated by the $wmgAllowLabsAnonEdits feature flag. That flag is only set to true for wikis in the wikidataclient-test dblist which is currently testwiki, test2wiki, and testwikidatawiki. This feature flag was introduced in rOMWCda44b986783c: Set $wgSoftBlockRanges for T154698: Prevent contributions attributed to private and WMF IP addresses.TASK DETAILhttps://phabricator.wikimedia.org/T208986EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, faidon, Gehel, Aklapper, Smalyshev, Legado_Shulgin, Nandana, JKSTNK, GTirloni, thifranc, Fheredia, AndyTan, sietec, Zylc, Davinaclare77, Bstorm, Qtn1293, 1978Gage2001, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Jonas, Xmlizer, srodlund, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T208986: WDQS tests can no longer edit test.wikidata.org
bd808 added subscribers: faidon, bd808.bd808 edited projects, added Cloud-VPS, cloud-services-team (Kanban); removed Cloud-Services.bd808 added a comment. The 10.68.0.0./16 range used by the legacy nova-network powered side of Cloud VPS is explictly allowed for some wikis in CommonSettings.php. We have not yet added a similar exemption for the new private address space that the Neutron powered eqiad1-r side of things is using. We need to either a) change the network routing so that the wikis see traffic as coming from our public IP space, or b) add an exemption for the 172.16.0.0/16 range we are now exposing. I think the preferred long term fix is (a), but we can quickly setup (b) to keep CI jobs working until we can make deeper routing changes.TASK DETAILhttps://phabricator.wikimedia.org/T208986EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, faidon, Gehel, Aklapper, Smalyshev, Legado_Shulgin, Nandana, JKSTNK, GTirloni, thifranc, Fheredia, AndyTan, sietec, Zylc, Davinaclare77, Bstorm, Qtn1293, 1978Gage2001, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, Allthingsgo, Th3d3v1ls, Hfbn0, QZanden, EBjune, Tbscho, merbst, LawExplorer, Zppix, JJMC89, Jonas, Xmlizer, srodlund, Wong128hk, Luke081515, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Gryllida, scfc, Mbch331, Jay8g, Krenair, fgiunchedi, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T208714: Request creation of soweego VPS project
bd808 added a comment. approved in #cloud-services-team meetingTASK DETAILhttps://phabricator.wikimedia.org/T208714EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GTirloni, bd808Cc: bd808, Hjfocs, MaxFrax96, Aklapper, Nandana, JKSTNK, GTirloni, Fheredia, AndyTan, sietec, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, Allthingsgo, QZanden, Tbscho, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T204698: cloudvps: wikidata-page-banner project trusty deprecation
bd808 edited projects, added Cloud-VPS (Ubuntu Trusty Deprecation); removed Cloud-VPS. TASK DETAILhttps://phabricator.wikimedia.org/T204698EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Harej, aborrero, Jdlrobson, Sumit, Aklapper, Nandana, JKSTNK, AndyTan, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, Winter, JJMC89, srodlund, Wikidata-bugs, aude, Gryllida, Lydia_Pintscher, scfc, Mbch331, Jay8g, bd808, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T204696: cloudvps: wikidata-dev project trusty deprecation
bd808 edited projects, added Cloud-VPS (Ubuntu Trusty Deprecation); removed Cloud-VPS. TASK DETAILhttps://phabricator.wikimedia.org/T204696EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, bd808Cc: Addshore, Wikidata, aborrero, Aklapper, Nandana, JKSTNK, AndyTan, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, bd808, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Assigned] T167154: Delete wikidata-ldf project on wmflabs
bd808 assigned this task to Andrew.bd808 added a project: cloud-services-team (Kanban). TASK DETAILhttps://phabricator.wikimedia.org/T167154EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Andrew, bd808Cc: CristianCantoro, Aklapper, AndyTan, sietec, Zylc, Bstorm, 1978Gage2001, Lahi, aborrero, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, bd808, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T195121: Contribution from the IGN to Structured Data on Commons
bd808 added a subscriber: Reedy.bd808 added a comment. Adding @Reedy as a subscriber because I know that he has been involved in large media uploads to commons before and may be able to offer a perspective on the question of using a disk and international post vs internet transfers. (For example how big the dataset needs to be before it is worth the effort of having someone in data center operations and someone else with production shell rights involved.)TASK DETAILhttps://phabricator.wikimedia.org/T195121EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Reedy, bd808, Aklapper, aborrero, SandraF_WMF, Platonides, Rodelar, abian, AndyTan, sietec, Zylc, 1978Gage2001, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, Tramullas, Acer, LawExplorer, JJMC89, Susannaanas, srodlund, Luke081515, Aschroet, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Gryllida, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, scfc, Steinsplitter, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T194881: Request creation of openrefine VPS project
bd808 closed this task as "Resolved".bd808 claimed this task.bd808 added a comment. Project created: https://tools.wmflabs.org/openstack-browser/project/openrefine When you build your instance, don't forget to enable the role::labs::lvm::srv Puppet role to provision the extra disk space beyond the basic 18G root partition.TASK DETAILhttps://phabricator.wikimedia.org/T194881EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Pintoch, Abbe98, Lucas_Werkmeister_WMDE, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, Bsandipan, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, Culex, JJMC89, srodlund, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T194767: Set up OpenRefine on Cloud VPS
bd808 closed subtask T194881: Request creation of openrefine VPS project as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T194767EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Abbe98, Pintoch, Lucas_Werkmeister_WMDE, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Culex, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T192292: Request to return 405 on POST calls to SPARQL endpoint, Wikidata primary sources tool VPS project
bd808 added a comment.
I could not find the listen 80; directive in any file in /etc/nginx on pst.wikidata-primary-sources-tool.eqiad.wmflabs. Nginx was running, but did not seem to be bound to port 80. I made these changes:
Added listen 80; to /etc/nginx/sites-available/pst
Symlinked /etc/nginx/sites-enabled/pst to /etc/nginx/sites-available/pst
Restarted nginx
I can now curl the nginx install locally:
$ curl -v http://localhost/
* Hostname was NOT found in DNS cache
* Trying ::1...
* connect to ::1 port 80 failed: Connection refused
* Trying 127.0.0.1...
* Connected to localhost (127.0.0.1) port 80 (#0)
> GET / HTTP/1.1
> User-Agent: curl/7.38.0
> Host: localhost
> Accept: */*
>
< HTTP/1.1 200 OK
* Server nginx/1.13.6 is not blacklisted
< Server: nginx/1.13.6
< Date: Thu, 31 May 2018 19:54:42 GMT
< Content-Type: text/html
< Content-Length: 612
< Last-Modified: Wed, 11 Oct 2017 07:33:46 GMT
< Connection: keep-alive
< ETag: "59ddc95a-264"
< Accept-Ranges: bytes
<
Welcome to nginx!
</span>
<span style="color: #808080">body {</span>
<span style="color: #808080">width: 35em;</span>
<span style="color: #808080">margin: 0 auto;</span>
<span style="color: #808080">font-family: Tahoma, Verdana, Arial, sans-serif;</span>
<span style="color: #808080">}</span>
<span style="color: #808080">
Welcome to nginx!
If you see this page, the nginx web server is successfully installed and
working. Further configuration is required.
For online documentation and support please refer to
Commercial support is available at
Thank you for using nginx.
* Connection #0 to host localhost left intact
The /etc/nginx/sites-available/pst config will need more settings added to it in order to reverse proxy to your Blazegraph instance. See https://docs.nginx.com/nginx/admin-guide/web-server/reverse-proxy/ for some help.TASK DETAILhttps://phabricator.wikimedia.org/T192292EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T192292: Request to return 405 on POST calls to SPARQL endpoint, Wikidata primary sources tool VPS project
bd808 added a comment. In T192292#4228593, @Hjfocs wrote: And sorry if the question sounds silly, I'm no sysadmin :-) It's never silly to ask questions. :) The IP that you see via curl belongs to the virtual machine in the project-proxy Cloud VPS project where the proxy server is currently deployed. This IP is from our public pool, meaning that it is reachable from the general internet. Your virtual machine instance does not have a public IP. It instead has a private (10.x.x.x) address that is allocated dynamically when the instance is first provisioned. I would suggest using simply listen 80;. Port 443 is for HTTPS traffic. The Cloud VPS proxy will take care of that for you and then reverse proxy via plain HTTP to nginx on your Cloud VPS instance. Using the bare port number is equivalent to listen *:80 which will make the nginx service available on all local IP addresses on the instance. This will not cause any security or performance problems and keeps you from needing to make the configuration exactly match the virtual machine's IP stack configuration.TASK DETAILhttps://phabricator.wikimedia.org/T192292EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Blocker] T192306: Create MCR test wiki on WM Cloud
bd808 changed the status of subtask T193185: Increase quota for wikidata-federation project from "Open" to "Stalled". TASK DETAILhttps://phabricator.wikimedia.org/T192306EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tgr, bd808Cc: aude, Tgr, bd808, CCicalese_WMF, Abit, Addshore, Aklapper, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T192292: Request to return 405 on POST calls to SPARQL endpoint, Wikidata primary sources tool VPS project
bd808 added a comment. In T192292#4196249, @Hjfocs wrote: Thanks for the update, @bd808 . the NGINX directive seemed to me the easiest way. I agree that it is easiest for you, but for us it creates a tight coupling between your Cloud VPS project and our infrastructure. This tight coupling will complicate all future changes that we make to the proxy layer. Its very likely that at some point your assumption of upstream protection from the shared proxy would end up being broken accidentally. In T192292#4196383, @Hjfocs wrote: In T192292#4196249, @Hjfocs wrote: For instance, would it be possible to setup a project-specific NGINX instance? I investigated that, but could not find any documentation. @bd808, talking about available VPS puppet profiles/roles There is a very full featured Puppet module for managing an nginx service, but there is not a convenient role or profile class that generically manages nginx for a project. The reason for this is fundamentally that a custom file or template is needed to configure the nginx server. The base nginx class sets up Puppet rules to ensure that only Puppet managed vhost configurations are enabled. This is a great practice for our production servers, but it makes things a bit more complicated for Cloud VPS projects. To use the ::nginx module in a Cloud VPS project you would need to write a custom role class and either get it merged into the main operations/puppet.git repo or setup a project local Puppetmaster and add the class there. The "easy" thing to do is sudo apt-get install nginx and then edit the configuration files, but Puppet automation can be nicer in the long term.TASK DETAILhttps://phabricator.wikimedia.org/T192292EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T192292: Request to return 405 on POST calls to SPARQL endpoint, Wikidata primary sources tool VPS project
bd808 added a comment. @Hjfocs I'm not convinced that adding project specific security features to the shared HTTPS proxy server is scalable or sustainable. It seems like it would be easier for you to introduce a security proxy within your project.TASK DETAILhttps://phabricator.wikimedia.org/T192292EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T192306: Create MCR test wiki on WM Cloud
bd808 added a comment. We now have both a quota increase request (T193185: Increase quota for wikidata-federation project) and a new project request (T194239: Request creation of mcr-dev VPS project) submitted with this goal as the parent. Are both actually needed? If only one is needed, which is the more useful?TASK DETAILhttps://phabricator.wikimedia.org/T192306EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: aude, bd808Cc: bd808, CCicalese_WMF, Abit, Addshore, Aklapper, daniel, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, JJMC89, Agabi10, Susannaanas, Aschroet, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T189747: Toolforge node for constraint reports updating bot
bd808 added a comment. Toolforge does not have "nodes" for particular tools. It is a shared grid environment where jobs are submitted either to a Grid Engine worker farm or to a Kubernetes cluster. Neither of these environments is going to be a great fit for a process that wants 64G of ram for long periods of time. At https://toolsadmin.wikimedia.org/tools/membership/status/262 I asked you if this was a continuous need or a peak processing burst, and you said "Bot`s algorithm loads Wikidata dump into memory and uses this data during several hours to generate all needed reports. So 64 GB is used continuously for several hours every day." This is sounding more like something that either needs to be optimized to use less memory (4G or so is 'normal' for a tool) or you need to file a #cloud-vps-project-requests ticket to ask for dedicated resources for your tool. It would be great to see you work with @Multichill a bit before rushing to try and get a dedicated server.TASK DETAILhttps://phabricator.wikimedia.org/T189747EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, zhuyifei1999, Multichill, Lydia_Pintscher, Wikibase-Quality-Constraints, Ivan_A_Krestinin, Aklapper, 1978Gage2001, Lahi, aborrero, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, Agabi10, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T186731: Request to set body size and read timeout values, Wikidata primary sources tool VPS project
bd808 closed this task as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T186731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: gerritbot, bd808, Aklapper, Hjfocs, Giuliamocci, Adrian1985, Cpaulf30, 1978Gage2001, Lahi, aborrero, Gq86, Baloch007, Darkminds3113, Lordiis, GoranSMilovanovic, Adik2382, Kiailandi, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tbscho, dachary, LawExplorer, Lewizho99, JJMC89, Maathavan, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T185572: Prepare 2.0 beta release
bd808 closed subtask T186731: Request to set body size and read timeout values, Wikidata primary sources tool VPS project as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T185572EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Hjfocs, bd808Cc: Aklapper, Hjfocs, Lahi, Gq86, GoranSMilovanovic, Kiailandi, QZanden, dachary, LawExplorer, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T186731: Request to set body size and read timeout values, Wikidata primary sources tool VPS project
bd808 edited projects, added Cloud-VPS, cloud-services-team (Kanban); removed cloud-services-team, Cloud-Services.bd808 claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T186731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T186731: Request to set body size and read timeout values, Wikidata primary sources tool VPS project
bd808 added a comment. Current config: proxy_read_timeout 3600s; client_max_body_size 128m;TASK DETAILhttps://phabricator.wikimedia.org/T186731EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, srodlund, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T179879: Provide a 5-minute timeout in WDQS for trusted users using OAuth
bd808 added a comment. In T179879#3998830, @doctaxon wrote: @bd808 @chasemp What is your meaning about this? @Smalyshev and his team are in charge of the WDQS software and servers.TASK DETAILhttps://phabricator.wikimedia.org/T179879EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: chasemp, bd808, Lydia_Pintscher, Magnus, MichaelSchoenitzer_WMDE, MisterSynergy, doctaxon, Jonas, matej_suchanek, Ash_Crow, Daniel_Mietchen, Lucas_Werkmeister_WMDE, Jane023, Base, Gehel, Smalyshev, Ijon, Aklapper, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T185637: Request for custom nginx configuration, Wikidata primary sources tool VPS project
bd808 added a comment. In T185637#3924302, @Hjfocs wrote: Example workflow: the client fires a POST to https://pst.wmflabs.org/pst/curate; the back-end service processes the client request; the service fires an internal HTTP request (i.e., via http://10.68.22.221:) to the storage engine, in order to update some data; the storage engine responds to the service; the service sends the final response to the client. Looking at the domain proxy setup, this translates to: the client fires a POST to https://pst.wmflabs.org/pst/curate; client connects to domain proxy nginx instance via public IP (208.80.155.156) Request includes Host: pst.wmflabs.org nginx on domain proxy server (at this moment, novaproxy-01.project-proxy.eqiad.wmflabs) reads HTTP payload to determine backend nginx on domain proxy server constructs a proxied HTTP POST request to http://10.68.22.221: This ip and port are selected because "pst.wmflabs.org" has been registered via Horizon to use this backing server and port. 10.68.22.221 is routed to the pst.wikidata-primary-sources-tool.eqiad.wmflabs VM the back-end service processes the client request; Blazegraph is running on port on pst.wikidata-primary-sources-tool.eqiad.wmflabs Blazegraph receives the POST the service fires an internal HTTP request (i.e., via http://10.68.22.221:) to the storage engine, in order to update some data; My knowledge of the stack stops here, but it sounds like Blazegraph talks to itself via HTTP? the storage engine responds to the service; Again, outside my knowledge of the deep stack activties the service sends the final response to the client. Blazegraph on pst.wikidata-primary-sources-tool.eqiad.wmflabs responds to the request from nginx on novaproxy-01.project-proxy.eqiad.wmflabs Nginx on novaproxy-01.project-proxy.eqiad.wmflabs responds to the client with the HTTP payload it received The problem: I'm unpredictably getting org.apache.http.NoHttpResponseException: 10.68.22.221: failed to respond. Step 4 fails. This seems to be raised by HTTP connections that get closed between step 1 and 3. Sending a Connection: Keep-Alive; header in step 3 doesn't fix the problem, while upstream + keepalive works. HTTP Keep-Alive would be a client connection pooling optimization for Blazegraph talking to Blazegraph. There is no nginx proxy intervening in this conversation unless Blazegraph is actually talking to itself via the proxied hostname (pst.wmflabs.org) rather than direct communication using the 10.68.22.221: ip and port. If you are using the public hostname instead of the direct ip or internal hostname, this seems potentially problematic just from the point of view of additional and unnecessary latency and routing complication. The only way that I see an nginx instance would be involved is if you are using the public hostname of the proxy instead of directly talking to the internal service via an ip or internal hostname. Is there a part of this stack that I am misunderstanding, or is your initial inbound request actually to some other end point?TASK DETAILhttps://phabricator.wikimedia.org/T185637EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T185637: Request for custom nginx configuration, Wikidata primary sources tool VPS project
bd808 added a comment. @Hjfocs, the domain proxy for Cloud VPS instances is a shared nginx server which uses a custom lookup function to map requests from the client to the appropriate backend VPS instance and port based on the inbound request's Host header. This setup does not use upstream blocks to describe the backends. Functionally this means that the solution you are describing is not possible when using the domain proxy. Can you provide more information about the problem you are hoping to solve with HTTP keepalive between the proxy and your backend server?TASK DETAILhttps://phabricator.wikimedia.org/T185637EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Kiailandi, Chicocvenancio, QZanden, Tbscho, dachary, LawExplorer, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T183274: import-dump command fails due to sudo broken file permissions
bd808 added a comment. Likely one of: the file is not readable in the VM for some reason (NFS/Vbox failure?) php in the VM does not have bzip support (configuration problem?) the archive is corrupt The next workaround I would try is decompressing the dump before importing.TASK DETAILhttps://phabricator.wikimedia.org/T183274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Lahi, Gq86, GoranSMilovanovic, Kiailandi, QZanden, dachary, LawExplorer, Luke081515, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T183274: import-dump command fails due to sudo broken file permissions
bd808 added a comment. On a local test server: $ cd $MY_MWVAGRANT_CHECKOUT $ ls -l Wikitech-2018055417.xml -rw-r--r--@ 1 bd808 staff 6.8K Jan 11 08:54 Wikitech-2018055417.xml $ vagrant import-dump Wikitech-2018055417.xml Done! You might want to run rebuildrecentchanges.php to regenerate RecentChanges, and initSiteStats.php to update page and revision counts Rebuilding $wgRCMaxAge=7776000 seconds (90 days) Clearing recentchanges table for time range... Loading from page and revision tables... Inserting from page and revision tables... Updating links and size differences... Loading from user, page, and logging tables... Flagging bot account edits... Flagging auto-patrolled edits... Removing duplicate revision and logging entries... Deleting feed timestamps. Done. One thing I just realized is that vagrant import-dump does not currently handle additional arguments like --wiki=wikidatawiki which would be needed to import the dump to a wiki other than the default (dbname "wiki"). You may be better off using mwscript and importDump.php manually inside the VM with something like: $ vagrant ssh $ cd /vagrant $ mwscript importDump.php --wiki=wikidatawiki --uploads $PATH_TO_DUMPTASK DETAILhttps://phabricator.wikimedia.org/T183274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Lahi, Gq86, GoranSMilovanovic, Kiailandi, QZanden, dachary, LawExplorer, Luke081515, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T184179: Missing references to s8 on maintenance and cloud scripts (and potentially others)
bd808 edited projects, added cloud-services-team (Kanban); removed Patch-For-Review.bd808 closed this task as "Resolved".bd808 added a comment. I think the #cloud-services bits are done now.TASK DETAILhttps://phabricator.wikimedia.org/T184179EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Stashbot, chasemp, ArielGlenn, akosiaris, Joe, gerritbot, bd808, Andrew, Marostegui, Aklapper, jcrespo, Qtn1293, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Tbscho, LawExplorer, Zppix, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T184179: Missing references to s8 on maintenance and cloud scripts (and potentially others)
bd808 added a comment. After running maintain-meta_p: (u3518@s7.labsdb) [meta_p]> SELECT * FROM meta_p.wiki WHERE dbname like 'wikidata%'\G *** 1. row *** dbname: wikidatawiki lang: en name: Wikidata family: wikidata url: https://www.wikidata.org size: 3 slice: s8.labsdb is_closed: 0 has_echo: 1 has_flaggedrevs: 0 has_visualeditor: 0 has_wikidata: 1 is_sensitive: 0 1 row in set (0.00 sec)TASK DETAILhttps://phabricator.wikimedia.org/T184179EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: Stashbot, chasemp, ArielGlenn, Dzahn, akosiaris, Joe, gerritbot, bd808, Andrew, Marostegui, Aklapper, jcrespo, Adrian1985, Qtn1293, Cpaulf30, 1978Gage2001, Lahi, Gq86, Baloch007, Darkminds3113, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, Tbscho, LawExplorer, Lewizho99, Zppix, JJMC89, Maathavan, Wikidata-bugs, aude, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T183274: import-dump command fails due to sudo broken file permissions
bd808 added a comment. sudo: /usr/bin/sudo must be owned by uid 0 and have the setuid bit set should never happen. This is pretty obviously a corrupted LXC container. If you run vagrant destroy -f && vagrant up && vagrant import-dump ... can you recreate this failure?TASK DETAILhttps://phabricator.wikimedia.org/T183274EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Lahi, Gq86, GoranSMilovanovic, Kiailandi, QZanden, dachary, LawExplorer, Luke081515, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T184179: Missing references to s8 on maintenance and cloud scripts (and potentially others)
bd808 added a comment. I think my patches above take care of the Cloud Services/Data Services side of this (DNS and views support). The scripts I patched will still need to be run to create/update the DNS records. I don't think that anything in the views will actually change as a result of the slice move.TASK DETAILhttps://phabricator.wikimedia.org/T184179EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: chasemp, ArielGlenn, Dzahn, akosiaris, Joe, gerritbot, bd808, Andrew, Marostegui, Aklapper, jcrespo, Qtn1293, Cpaulf30, 1978Gage2001, Lahi, Gq86, Baloch007, Darkminds3113, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, Tbscho, LawExplorer, Lewizho99, Zppix, JJMC89, Maathavan, Wikidata-bugs, aude, Gryllida, faidon, scfc, Mbch331, Jay8g, Krenair, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T173818: [Epic] Kill the Wikidata build step
bd808 closed subtask T181769: Update role::wikidata to work with new (no)build process as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, bd808Cc: bd808, Stashbot, gerritbot, Izno, Smalyshev, Ladsgroup, Ricordisamoa, Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Liudvikas, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T183229: Request to access shared storage on the Wikidata primary sources tool VPS project
bd808 edited projects, added cloud-services-team (Kanban); removed cloud-services-team. TASK DETAILhttps://phabricator.wikimedia.org/T183229EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: gerritbot, chasemp, Aklapper, Hjfocs, Cpaulf30, 1978Gage2001, Lahi, aborrero, Gq86, Baloch007, Darkminds3113, Lordiis, GoranSMilovanovic, Adik2382, Kiailandi, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tbscho, dachary, LawExplorer, Lewizho99, JJMC89, Maathavan, Luke081515, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, bd808, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T181836: Delete the wikidata-build cloud VPS project
bd808 edited projects, added Cloud-VPS (Project-requests); removed Cloud-VPS. TASK DETAILhttps://phabricator.wikimedia.org/T181836EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, gerritbot, Addshore, Lahi, aborrero, Gq86, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T181836: Delete the wikidata-build cloud VPS project
bd808 added a project: cloud-services-team (Kanban). TASK DETAILhttps://phabricator.wikimedia.org/T181836EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, gerritbot, Addshore, Lahi, aborrero, Gq86, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T181836: Delete the wikidata-build cloud VPS project
bd808 added a comment. @Addshore it looks like all the VMs are gone from wikidata-build. Are you ready for us to rm the project itself?TASK DETAILhttps://phabricator.wikimedia.org/T181836EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, bd808Cc: bd808, Aklapper, gerritbot, Addshore, Lahi, Gq86, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T181401: wikidatawiki_p.wb_items_per_site query is slower than expected on Wiki Replicas
bd808 renamed this task from "Wikidata is slow on Wiki Replicas" to "wikidatawiki_p.wb_items_per_site query is slower than expected on Wiki Replicas". TASK DETAILhttps://phabricator.wikimedia.org/T181401EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: zhuyifei1999, Legoktm, Dispenser, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, Tbscho, Vali.matei, JJMC89, Volker_E, Wikidata-bugs, aude, GWicke, Gryllida, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T173818: [Epic] Kill the Wikidata build step
bd808 added a subtask: T181769: Update role::wikidata to work with new (no)build process. TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, bd808Cc: bd808, Stashbot, gerritbot, Izno, Smalyshev, Ladsgroup, Ricordisamoa, Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, Lahi, Gq86, Baloch007, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T173818: [Epic] Kill the Wikidata build step
bd808 added a comment. The MediaWiki-Vagrant role clones https://gerrit.wikimedia.org/r/wikidata/build-resources. Does that need some replacement as well?TASK DETAILhttps://phabricator.wikimedia.org/T173818EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, bd808Cc: bd808, Stashbot, gerritbot, Izno, Smalyshev, Ladsgroup, Ricordisamoa, Jrbranaa, Liuxinyu970226, demon, VColeman, Jdforrester-WMF, Lucas_Werkmeister_WMDE, Agabi10, aude, hoo, Jonas, Aleksey_WMDE, WMDE-leszek, thiemowmde, daniel, Lydia_Pintscher, greg, Legoktm, Addshore, Aklapper, Lahi, Gq86, Baloch007, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Luke081515, Wikidata-bugs, zeljkofilipin, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T178661: Drop wb_entity_per_page views in Wiki Replicas
bd808 closed this task as "Resolved".bd808 added a comment. labsdb1003 will be shutdown in 2 weeks. The "damage" prior to that is just that there is a view available on the wikidatawiki.labsdb database that points to non-existent tables. In the longer term we should make some changes to maintain-views so that it can drop a single view without needing to rebuild all of the views for the database.TASK DETAILhttps://phabricator.wikimedia.org/T178661EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Andrew, bd808Cc: Stashbot, bd808, chasemp, Magnus, hoo, daniel, jcrespo, Marostegui, Aklapper, Ladsgroup, Lahi, aborrero, Gq86, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T177601: Deploy dropping wb_entity_per_page table
bd808 closed subtask T178661: Drop wb_entity_per_page views in Wiki Replicas as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T177601EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, bd808Cc: Stashbot, Marostegui, jcrespo, daniel, Aklapper, hoo, gerritbot, Magnus, Ricordisamoa, Bamyers99, Tobi_WMDE_SW, Pasleim, PokestarFan, Ladsgroup, Lahi, Gq86, Baloch007, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Assigned] T178661: Drop wb_entity_per_page views in Wiki Replicas
bd808 assigned this task to chasemp.bd808 added a comment. Assigning to @chasemp as current on-call. This fell through the cracks.TASK DETAILhttps://phabricator.wikimedia.org/T178661EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chasemp, bd808Cc: bd808, chasemp, Magnus, hoo, daniel, jcrespo, Marostegui, Aklapper, Ladsgroup, Lahi, aborrero, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180347: Request creation of wikidata-primary-sources-tool VPS project
bd808 added a comment. +1 once labvirt1015 is online and we have a bit more space for VMsTASK DETAILhttps://phabricator.wikimedia.org/T180347EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Hjfocs, Lahi, GoranSMilovanovic, Kiailandi, QZanden, Tbscho, dachary, JJMC89, Wikidata-bugs, aude, Gryllida, Ricordisamoa, Sjoerddebruin, Tpt, scfc, Mbch331, Jay8g, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T179663: What happens if the Wikibase project specifies a version of a library outside of the range included in mediawiki-vendor?
bd808 added a comment. @Legoktm nailed it. If wikibase is going to use the same process as the rest of the Foundation production deployed extensions it needs to go all in on that including in the CI chain and the library update process. The current system can probably be improved, but that is a topic for another ticket (like T178137).TASK DETAILhttps://phabricator.wikimedia.org/T179663EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, Aklapper, Legoktm, greg, Lydia_Pintscher, daniel, thiemowmde, WMDE-leszek, Aleksey_WMDE, Jonas, hoo, aude, Agabi10, Lucas_Werkmeister_WMDE, Jdforrester-WMF, VColeman, demon, Liuxinyu970226, Jrbranaa, Ricordisamoa, Addshore, Lahi, SandraF_WMF, GoranSMilovanovic, QZanden, Liudvikas, Luke081515, Wikidata-bugs, Anomie, zeljkofilipin, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178661: Drop wb_entity_per_page views in Wiki Replicas
bd808 added a comment. Actually we probably just need maintain-views --databases wikidatawiki --clean rather than all wikis.TASK DETAILhttps://phabricator.wikimedia.org/T178661EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: bd808Cc: bd808, chasemp, Magnus, hoo, daniel, jcrespo, Marostegui, Aklapper, Ladsgroup, Lahi, aborrero, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
