[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-12-01 Thread Maintenance_bot 
Maintenance_bot removed a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus, Maintenance_bot
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Danny_Benjafield_WMDE, kamila, Astuthiodit_1, Lmlmljs, 
Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, jijiki, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, Volans, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris, 
Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
786, Biggs657, Juan90264, Alter-paule, Beast1978, Un1tY, Hook696, Kent7301, 
joker88john, CucyNoiD, Gaboe420, Giuliamocci, Cpaulf30, Af420, Bsandipan, 
Lewizho99, Maathavan, Neuronton
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-12-01 Thread gerritbot 
gerritbot added a comment.


  Change 737498 **abandoned** by Ladsgroup:
  
  [operations/puppet@production] [WIP] mediawiki-cache-warmup: Add support for 
POST requests
  
  Reason:
  
  Superseded by better patches 
  
  https://gerrit.wikimedia.org/r/737498

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus, gerritbot
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Danny_Benjafield_WMDE, Isabelladantes1983, kamila, 
Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 
Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, Alter-paule, 
Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, joker88john, 
CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Volans, 
Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-05-04 Thread RLazarus 
RLazarus closed this task as "Resolved".
RLazarus added a comment.


  We can't really test this without draining a DC, but we'll find out at the 
next switchover whether this is still a problem, and if so we can open a new 
task. Resolving with bold optimism in the meantime.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-05-04 Thread gerritbot 
gerritbot added a comment.


  Change 892570 **merged** by RLazarus:
  
  [operations/puppet@production] mediawiki-cache-warmup: Add POSTs
  
  https://gerrit.wikimedia.org/r/892570

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus, gerritbot
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-05-04 Thread gerritbot 
gerritbot added a comment.


  Change 892569 **merged** by RLazarus:
  
  [operations/puppet@production] mediawiki-cache-warmup: Rename `Request` to 
`Task`
  
  https://gerrit.wikimedia.org/r/892569

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus, gerritbot
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-28 Thread Ladsgroup 
Ladsgroup added a comment.


  Sigh, this is not very useful:
  
mysql:research@s1-analytics-replica.eqiad.wmnet [enwiki]> select 
page_title, page_namespace, count(*) from wbc_entity_usage join page on 
eu_page_id = page_id where page_namespace = 0 group by eu_page_id order by 
count(*) desc limit 50;

+++--+
| page_title | 
page_namespace | count(*) |

+++--+
| List_of_lighthouses_in_China   |  
0 | 2209 |
| List_of_dams_in_Hokkaido   |  
0 | 2075 |
| List_of_lighthouses_in_Scotland|  
0 | 1666 |
| List_of_Polish_mathematicians  |  
0 | 1363 |
| List_of_crossings_of_the_River_Thames  |  
0 | 1324 |
| List_of_learned_societies  |  
0 | 1287 |
| Ying_Fan_Reinfelder|  
0 | 1260 |
| List_of_lighthouses_in_Argentina   |  
0 | 1216 |
| Lidia_Morawska |  
0 | 1007 |
| Listed_buildings_at_the_University_of_Leeds|  
0 |  921 |
| Lightvessel_stations_of_Great_Britain  |  
0 |  816 |
| List_of_learned_societies_in_the_United_Kingdom|  
0 |  774 |
| List_of_dams_in_Akita_Prefecture   |  
0 |  742 |
| List_of_parks_and_open_spaces_in_the_London_Borough_of_Croydon |  
0 |  731 |
| List_of_dams_in_Yamaguchi_Prefecture   |  
0 |  706 |
| List_of_dams_in_Toyama_Prefecture  |  
0 |  696 |
| List_of_dams_in_Yamagata_Prefecture|  
0 |  673 |
| List_of_dams_in_Hyogo_Prefecture   |  
0 |  652 |
| List_of_dams_in_Gifu_Prefecture|  
0 |  638 |
| List_of_monuments_in_Meknes|  
0 |  629 |
| List_of_lighthouses_in_Madagascar  |  
0 |  617 |
| Catenin_beta-1 |  
0 |  614 |
| List_of_monuments_in_Rabat,_Morocco|  
0 |  591 |
| List_of_dams_in_Hiroshima_Prefecture   |  
0 |  565 |
| List_of_dams_in_Chiba_Prefecture   |  
0 |  562 |
| List_of_lightvessels_of_Great_Britain  |  
0 |  557 |
| List_of_dams_in_Nagano_Prefecture  |  
0 |  547 |
| List_of_dams_in_Kagawa_Prefecture  |  
0 |  539 |
| TGF_beta_1 |  
0 |  533 |
| List_of_lighthouses_in_Japan   |  
0 |  521 |
| Bone_morphogenetic_protein_4   |  
0 |  507 |
| List_of_mountain_peaks_by_prominence   |  
0 |  503 |
| List_of_dams_in_Fukuoka_Prefecture |  
0 |  499 |
| Notch_1|  
0 |  491 |
| Sonic_hedgehog_protein |  
0 |  487 |
| P53|  
0 |  483 |
| Protein_Wnt-5a |  
0 |  483 |
| Dopamine_receptor_D2   |  
0 |  481 |
| List_of_dams_in_Shimane_Prefecture |  
0 |  480 |
| AKT1   |  
0 |  475 |
| List_of_learned_societies_in_the_United_States |  
0 |  468 |
| List_of_crossings_of_the_Danube|  
0 |  467 |
| List_of_monuments_in_Marrakesh |  
0 |  461 |
| List_of_dams_in_Fukushima_Prefecture   |  
0 |

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-27 Thread gerritbot 
gerritbot added a comment.


  Change 892570 had a related patch set uploaded (by RLazarus; author: 
RLazarus):
  
  [operations/puppet@production] mediawiki-cache-warmup: Add POSTs
  
  https://gerrit.wikimedia.org/r/892570

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus, gerritbot
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-27 Thread gerritbot 
gerritbot added a comment.


  Change 892569 had a related patch set uploaded (by RLazarus; author: 
RLazarus):
  
  [operations/puppet@production] mediawiki-cache-warmup: Rename `Request` to 
`Task`
  
  https://gerrit.wikimedia.org/r/892569

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus, gerritbot
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-24 Thread RLazarus 
RLazarus claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-24 Thread RLazarus 
RLazarus closed subtask T288867: Rewrite mw-warmup.js in Python as 
Resolved.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-09 Thread RLazarus 
RLazarus added a subtask: T288867: Rewrite mw-warmup.js in Python.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-08 Thread Ladsgroup 
Ladsgroup added a comment.


  Yeah, that's better.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-08 Thread Lucas_Werkmeister_WMDE 
Lucas_Werkmeister_WMDE added a comment.


  Does Hubble use a lot of Wikidata data? Its infobox wikitext is fairly long, 
and South Pole Telescope  
is our more common Wikidata showcase page, where the infobox in wikitext is 
just `{{Infobox telescope|refs=yes|suppressfields=namedafter}}`. (The Commons 
category for Hubble probably uses Wikidata more, though.)

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-08 Thread Ladsgroup 
Ladsgroup added a comment.


  Yeah, rewrite in python sounds like a great idea. Stuff like:
  
  - https://en.wikipedia.org/wiki/Hubble_Space_Telescope?action=purge
  - 
https://commons.wikimedia.org/wiki/Category:Hubble_Space_Telescope?action=purge
  
  (POST so they would actually reparse the page). This should probably happen 
in parallel on every appserver to warm up the APCu cache too.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-07 Thread RLazarus 
RLazarus added a comment.


  POSTs will probably have to wait for the Python rewrite, but then they'll be 
easy. Can you recommend specific requests?

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-07 Thread Ladsgroup 
Ladsgroup added a comment.


  The urls that could make reads to s8 are mostly POSTs, the s8 warmup doesn't 
mean wikidata.org reads here. It means reparsing Hubble Space Telescope 
 in English Wikipedia and 
reparse several categories in Commons. So the warmup script needs to be able to 
do POST reqs. That's the complicating factor, otherwise I would have done it 
last time.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-06 Thread RLazarus 
RLazarus added a comment.


  In that case it sounds like yes, we do need cache warming in eqiad before 
repooling it -- and we'll need to add URLs to warm up s8, per this task.
  
  The Python rewrite doesn't have to be related -- for now, the new script will 
read URLs from the same files as the old script (urls-cluster.txt 
)
 so feel free to add entries there without waiting for me. That might change, 
but if so I'll coordinate, so in the meantime don't worry about it.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-06 Thread Clement_Goubert 
Clement_Goubert added a comment.


  I've created T328903: March 2023 Datacenter Switchover eqiad pooling schedule 
 to discuss the pooling schedule.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Clement_Goubert
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-06 Thread ayounsi 
ayounsi added a comment.


  It's technically possible but a more aggressive schedule would require the 
buy-in from everybody (including services that only live in eqiad like 
analytics).
  We can see it as "ripping the band-aid" vs. going carefully.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ayounsi
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-06 Thread Marostegui 
Marostegui added a subscriber: ayounsi.
Marostegui added a comment.


  If we are going to leave eqiad fully depooled for a week...can we do the 
switches operation during that time or leave eqiad depooled for longer and fit 
them there? @ayounsi thoughts?

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: ayounsi, Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, 
LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, 
LisafBia6531, Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, 
Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, 
Kent7301, joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, 
Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, 
LawExplorer, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Neuronton, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-06 Thread Clement_Goubert 
Clement_Goubert added a comment.


  In T290989#8586318 , 
@RLazarus wrote:
  
  > Are we also planning to depool eqiad for reads, and serve fully from codfw 
for any of the switchover period? If so, will we need cache warming in eqiad 
before repooling?
  
  According to 
https://wikitech.wikimedia.org/wiki/Switch_Datacenter#Overall_switchover_flow 
we'll leave eqiad completely depooled at the traffic level for 1 week, followed 
by 7 weeks of multi-DC with eqiad as the RO datacenter.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Clement_Goubert
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-03 Thread RLazarus 
RLazarus added a comment.


  Agree we don't need it in order to switch the RW site to codfw.
  
  Are we also planning to depool eqiad for reads, and serve fully from codfw 
for any of the switchover period? If so, will we need cache warming in eqiad 
before repooling?

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RLazarus
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-02 Thread Marostegui 
Marostegui added a comment.


  From the DB point of view, we don't really need this anymore.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-02 Thread Ladsgroup 
Ladsgroup added a comment.


  I personally don't think it's needed anymore due to multidc, but Manuel might 
disagree.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2023-02-02 Thread Clement_Goubert 
Clement_Goubert added subscribers: RLazarus, Clement_Goubert.
Clement_Goubert added a comment.


  @RLazarus You were working on rewriting the app server warmup script in 
Python, I suppose this is directly related.
  
  Considering we are in a multi-dc state now, impact on switchover should be 
less, but @Marostegui @Ladsgroup do you think work needs to happen on this 
before T327920: March 2023 Datacenter Switchover 
 ?

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Clement_Goubert
Cc: Clement_Goubert, RLazarus, Lydia_Pintscher, karapayneWMDE, LSobanski, 
Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, 
Astuthiodit_1, Lmlmljs, 786, Biggs657, Invadibot, maantietaja, Juan90264, 
Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Hook696, Kent7301, 
joker88john, CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, 
Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, 
Volans, Maathavan, _jensen, rosalieper, Neuronton, Scott_WUaS, Wikidata-bugs, 
aude, Mbch331, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2022-01-17 Thread Ladsgroup 
Ladsgroup added a comment.


  In T290989#7625301 , 
@Addshore wrote:
  
  >> i made a non-working PoC for it already.
  >
  > Where? :)
  
  The patch attached to this ticket I guess ;)

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Lydia_Pintscher, karapayneWMDE, LSobanski, Krinkle, Addshore, jcrespo, 
Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, Legoktm, Aklapper, 786, Suran38, 
Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, 
Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, RhinosF1, joker88john, 
CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Volans, 
Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, 
Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2022-01-17 Thread Addshore 
Addshore added a comment.


  > i made a non-working PoC for it already.
  
  Where? :)

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Lydia_Pintscher, karapayneWMDE, LSobanski, Krinkle, Addshore, jcrespo, 
Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, Legoktm, Aklapper, 786, Suran38, 
Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, 
Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, RhinosF1, joker88john, 
CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Volans, 
Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, 
Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2022-01-16 Thread Ladsgroup 
Ladsgroup edited projects, added Data-Persistence (Consultation); removed DBA.
Ladsgroup added subscribers: karapayneWMDE, Lydia_Pintscher.
Ladsgroup added a comment.


  Hi @karapayneWMDE @Addshore and @Lydia_Pintscher. Can your team take a look 
at this? i made a non-working PoC for it already.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Lydia_Pintscher, karapayneWMDE, LSobanski, Krinkle, Addshore, jcrespo, 
Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, Legoktm, Aklapper, 786, Suran38, 
Biggs657, Invadibot, Lalamarie69, maantietaja, Juan90264, Alter-paule, 
Beast1978, Un1tY, Akuckartz, Hook696, Kent7301, RhinosF1, joker88john, 
CucyNoiD, Nandana, jijiki, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, 
Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Volans, 
Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, 
Krenair, akosiaris, Devnull, Iflorez, Minhnv-2809, Jay8g
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-11-08 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, 786, Suran38, Biggs657, Invadibot, Lalamarie69, 
Devnull, maantietaja, Juan90264, Alter-paule, Beast1978, Un1tY, Akuckartz, 
Hook696, Iflorez, Kent7301, RhinosF1, joker88john, CucyNoiD, Nandana, jijiki, 
Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, 
GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, 
Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, 
Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-11-08 Thread gerritbot 
gerritbot added a comment.


  Change 737498 had a related patch set uploaded (by Ladsgroup; author: Amir 
Sarabadani):
  
  [operations/puppet@production] [WIP] mediawiki-cache-warmup: Add support for 
POST requests
  
  https://gerrit.wikimedia.org/r/737498

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: LSobanski, Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, 
Ladsgroup, Legoktm, Aklapper, Invadibot, Devnull, maantietaja, Akuckartz, 
Iflorez, RhinosF1, Nandana, jijiki, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, Minhnv-2809, Volans, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331, Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-16 Thread Addshore 
Addshore added a comment.


  In T290989#7357506 , 
@Legoktm wrote:
  
  > My understanding is that WANCache only sets values in the current DC, but 
invalidation is relayed to both DCs. Main stash would set the values across 
both DCs, see https://www.mediawiki.org/wiki/Manual:Object_cache#Main_stash
  
  Right, and reading that we probably don't want to use Main stash for this.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Invadibot, Devnull, LSobanski, maantietaja, Akuckartz, 
Iflorez, RhinosF1, Nandana, jijiki, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, Minhnv-2809, Volans, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331, Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-15 Thread Legoktm 
Legoktm added a comment.


  In T290989#7354905 , 
@Addshore wrote:
  
  > Correct me if I am wrong, but this would also be solved by this cache using 
WANCache rather than just a BagOStuff?
  
  My understanding is that WANCache only sets values in the current DC, but 
invalidation is relayed to both DCs. Main stash would set the values across 
both DCs, see https://www.mediawiki.org/wiki/Manual:Object_cache#Main_stash

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Legoktm
Cc: Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Invadibot, Devnull, LSobanski, maantietaja, Akuckartz, 
Iflorez, RhinosF1, Nandana, jijiki, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, Minhnv-2809, Volans, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331, Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-15 Thread Marostegui 
Marostegui triaged this task as "Medium" priority.
Marostegui moved this task from Triage to Blocked on the DBA board.
Marostegui added a comment.


  Just to mention that this is a nice-to-have indeed but not something that 
brought us down or anything close to that - it just required some load 
switching on the load balancer to help the latency to improve.
  We are now in a much more better position that we were a few switchovers ago 
as we have added (in the last couple of years) additional capacity on our s8 
(wikidata) section.
  
  I don't know how much work this requires to make it happen but it is 
certainly something that would be a benefit especially as wikidata keeps 
growing and growing (yay!).

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1060/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Krinkle, Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, 
Legoktm, Aklapper, Invadibot, Devnull, LSobanski, maantietaja, Akuckartz, 
Iflorez, RhinosF1, Nandana, jijiki, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, Minhnv-2809, Volans, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331, Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-15 Thread Addshore 
Addshore added a comment.


  Correct me if I am wrong, but this would also be solved by this cache using 
WANCache rather than just a BagOStuff?

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, Legoktm, 
Aklapper, Invadibot, Devnull, LSobanski, maantietaja, Akuckartz, Iflorez, 
RhinosF1, Nandana, jijiki, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
Minhnv-2809, Volans, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331, Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-14 Thread Ladsgroup 
Ladsgroup added a subscriber: Addshore.
Ladsgroup added a comment.


  
https://grafana.wikimedia.org/d/00548/wikibase-sql-term-storage?orgId=1=1631626432679=1631638695040
  
  F34643090: image.png 
  
  It is a bit scary that cache hit reducing to 94% could bring down s8 but I 
guess there is no way around it.

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: Addshore, jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, Legoktm, 
Aklapper, Invadibot, Devnull, LSobanski, maantietaja, Akuckartz, Iflorez, 
RhinosF1, Nandana, jijiki, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
Minhnv-2809, Volans, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331, Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-14 Thread Legoktm 
Legoktm created this task.
Legoktm added projects: Wikidata, Datacenter-Switchover, DBA.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: wdwb-tech.

TASK DESCRIPTION
  s8 was struggling today after the DC switchover, and it was suggested that we 
add some URLs to the cache warmup for Wikidata.
  
  (log trimmed)
  
07:53:09 <_joe_> marostegui: do we have dbs suffering?
07:53:15 <@marostegui> yes, s8
07:54:08  (once this is all done): marostegui let's talk about if 
there is anything on wikibase side is needed
07:56:06  is it 
Wikibase\Lib\Store\Sql\Terms\DatabaseTermInLangIdsResolver::selectTermsViaJoin ?
07:56:34  that's termstore replacement
07:56:42  I think because cache is cold
07:56:48  (memcached for term store)
07:56:52  mine it is just a guess because it is the only query I am 
seeing
07:57:04  on the heavy hit servers
07:57:34  maybe for the next dc switch we should "warm it up" 
beforehand
07:57:41 <_joe_> Amir1: yes definitely
07:57:50  I see a few fetchterms too
07:57:51 <@legoktm> we can add some Wikidata URLs to the warmup
07:58:03 <@marostegui> legoktm: that'd be nice indeed
07:58:20  legoktm: it's a common misconception: most of reads on s8 
are not coming from wikidata.org
07:58:30  this needs some parsing
07:59:17 <@legoktm> Amir1: "URLs that warmup the relevant Wikidata paths :)"
07:59:25  better :D
  
  The URLs that are currently hit as part of the warmup process are located at 
https://gerrit.wikimedia.org/g/operations/puppet/+/545b517cea678d8fdeadeb6051e0f3757bd4ebff/modules/mediawiki/files/maintenance/mediawiki-cache-warmup/

TASK DETAIL
  https://phabricator.wikimedia.org/T290989

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Legoktm
Cc: jcrespo, Marostegui, Lucas_Werkmeister_WMDE, Ladsgroup, Legoktm, Aklapper, 
Invadibot, Devnull, LSobanski, maantietaja, Akuckartz, Iflorez, RhinosF1, 
Nandana, jijiki, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
Minhnv-2809, Volans, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Addshore, Mbch331, Jay8g, Krenair, akosiaris
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org