[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[jcrespo]

jcrespo added a comment.


  One thing that may be relevant here is that the query may have worked once or 
twice in the last 6 months due to this underlying issue. Last update that 
completed successfully was 27 March. In effect, because this bug, this wasn't 
disabled officially but it was already (for the most part) not-working (but 
still causing issues before the merge).

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jcrespo
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, darthmon_wmde, Nandana, 
jijiki, Amorymeltzer, Imarlier, Lahi, Gq86, Lsherwinforone, GoranSMilovanovic, 
Jayprakash12345, QZanden, LawExplorer, Sethakill, elukey, _jensen, rosalieper, 
Scott_WUaS, Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, 
Mbch331, Rxy, Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Lea_Lacroix_WMDE]

Lea_Lacroix_WMDE added a comment.


  Can we keep the task open a few more days? I just sent the announcement to 
the community 
https://www.wikidata.org/wiki/Wikidata:Project_chat#Special:FewestRevisions_to_be_disabled
 and I just want to make sure that there's no strong veto. But everything 
should be fine.

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lea_Lacroix_WMDE
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, darthmon_wmde, Nandana, 
jijiki, Amorymeltzer, Imarlier, Lahi, Gq86, Lsherwinforone, GoranSMilovanovic, 
Jayprakash12345, QZanden, LawExplorer, Sethakill, elukey, _jensen, rosalieper, 
Scott_WUaS, Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, 
Mbch331, Rxy, Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[ArielGlenn]

ArielGlenn added a comment.


  Unless folks want to keep it open to work on speeding it up in the future?

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, darthmon_wmde, Nandana, 
jijiki, Amorymeltzer, Imarlier, Lahi, Gq86, Lsherwinforone, GoranSMilovanovic, 
Jayprakash12345, QZanden, LawExplorer, Sethakill, elukey, _jensen, rosalieper, 
Scott_WUaS, Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, 
Mbch331, Rxy, Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Marostegui]

Marostegui added a comment.


  The above patch to remove the cronjob has been merged, and the cronjob 
manually removed from mwmaint1002.
  I guess this can be resolved @Ladsgroup?

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, Blissjay007, Oblanco79, 
Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, jijiki, Gaboe420, Versusxo, Majesticalreaper22, Amorymeltzer, 
Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Af420, Darkminds3113, 
Bsandipan, Lordiis, Lsherwinforone, GoranSMilovanovic, Adik2382, 
Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Sethakill, 
WSH1906, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, 
Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[gerritbot]

gerritbot added a comment.


  Change 596172 **merged** by ArielGlenn:
  [operations/puppet@production] mediawiki: Disable fewestrevisions for wikidata
  
  https://gerrit.wikimedia.org/r/596172

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, Blissjay007, Oblanco79, 
Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, jijiki, Gaboe420, Versusxo, Majesticalreaper22, Amorymeltzer, 
Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Af420, Darkminds3113, 
Bsandipan, Lordiis, Lsherwinforone, GoranSMilovanovic, Adik2382, 
Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Sethakill, 
WSH1906, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, 
Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Marostegui]

Marostegui added a comment.


  And this just happened again:
  
| 1953784190 | wikiadmin| 10.64.16.77:53846  | wikidatawiki 
  | Query   |   44238 | Copying to tmp table on disk
  | SELECT /* SpecialFewestRevisions::reallyDoQuery  */  
page_namespace AS `namespace`,page_title AS `ti |0.000 |
  
  I killed this on mwmain1002:
  
www-data 221626  0.0  0.0   4276   740 ?Ss   01:00   0:00 /bin/sh 
-c /usr/local/bin/mwscriptwikiset updateSpecialPages.php s8.dblist --override 
--only=Fewestrevisions > 
/var/log/mediawiki/updateSpecialPages/s...@18-fewestrevisions.log 2>&1
www-data 221646  0.0  0.0  11180  2832 ?S01:00   0:00 /bin/bash 
/usr/local/bin/mwscriptwikiset updateSpecialPages.php s8.dblist --override 
--only=Fewestrevisions
``

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, Blissjay007, Oblanco79, 
Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, jijiki, Gaboe420, Versusxo, Majesticalreaper22, Amorymeltzer, 
Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Af420, Darkminds3113, 
Bsandipan, Lordiis, Lsherwinforone, GoranSMilovanovic, Adik2382, 
Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Sethakill, 
WSH1906, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, 
Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-05-27T13:18:59Z]  
Kill /usr/local/bin/mwscriptwikiset updateSpecialPages.php s8.dblist --override 
--only=Fewestrevisions T238199 

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, Blissjay007, Oblanco79, 
Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, jijiki, Gaboe420, Versusxo, Majesticalreaper22, Amorymeltzer, 
Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Af420, Darkminds3113, 
Bsandipan, Lordiis, Lsherwinforone, GoranSMilovanovic, Adik2382, 
Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Sethakill, 
WSH1906, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, 
Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Ladsgroup]

Ladsgroup added a comment.


  With the announcement done 
,
 this can move forward on our side

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: SilentSpike, WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, Blissjay007, Oblanco79, 
Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, jijiki, Gaboe420, Versusxo, Majesticalreaper22, Amorymeltzer, 
Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Af420, Darkminds3113, 
Bsandipan, Lordiis, Lsherwinforone, GoranSMilovanovic, Adik2382, 
Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Sethakill, 
WSH1906, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, 
Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[ArielGlenn]

ArielGlenn added a comment.


  In T238199#6135018 , 
@Ladsgroup wrote:
  
  > 
  
  ...
  
  > Anyway, Lydia said it's fine to do it tomorrow when it gets announced by 
our communication manager. Does that work for you?
  
  Anything's fine as long as there's a plan of some sort before next month, so, 
sure!

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, Blissjay007, Oblanco79, 
Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, jijiki, Gaboe420, Versusxo, Majesticalreaper22, Amorymeltzer, 
Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Af420, Darkminds3113, 
Bsandipan, Lordiis, Lsherwinforone, GoranSMilovanovic, Adik2382, 
Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Sethakill, 
WSH1906, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, 
Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Ladsgroup]

Ladsgroup added a comment.


  In T238199#6132549 , 
@ArielGlenn wrote:
  
  > Can we do this temporarily while the query is being fixed up? It looks like 
it had to be killed in Nov, Feb, Apr, May, so I'd rather temp disable than 
require folks to shoot it (and anything else hung as a side effect).
  
  I understand but the point is that for example, there might be an 
announcement needed or this might be needed in a vital system (like reporting 
for Q reviews and such) that we don't know. This kind of changes should be 
communicated in order to avoid surprises and suboptimal incidents.
  
  Anyway, Lydia said it's fine to do it tomorrow when it gets announced by our 
communication manager. Does that work for you?

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: WMDE-leszek, ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, 
Lydia_Pintscher, Aklapper, Ladsgroup, Marostegui, Blissjay007, Oblanco79, 
Alter-paule, Beast1978, Un1tY, Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, 
darthmon_wmde, Kent7301, Meekrab2012, joker88john, CucyNoiD, Nandana, 
NebulousIris, jijiki, Gaboe420, Versusxo, Majesticalreaper22, Amorymeltzer, 
Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Af420, Darkminds3113, 
Bsandipan, Lordiis, Lsherwinforone, GoranSMilovanovic, Adik2382, 
Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Sethakill, 
WSH1906, Lewizho99, Maathavan, elukey, _jensen, rosalieper, Scott_WUaS, 
Wong128hk, Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, 
Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[ArielGlenn]

ArielGlenn added a comment.


  Can we do this temporarily while the query is being fixed up? It looks like 
it had to be killed in Nov, Feb, Apr, May, so I'd rather temp disable than 
require folks to shoot it (and anything else hung as a side effect).

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, Lydia_Pintscher, Aklapper, 
Ladsgroup, Marostegui, Blissjay007, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, jijiki, Gaboe420, 
Versusxo, Majesticalreaper22, Amorymeltzer, Giuliamocci, Adrian1985, Cpaulf30, 
Imarlier, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, Lsherwinforone, 
GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, 
QZanden, LawExplorer, Sethakill, WSH1906, Lewizho99, Maathavan, elukey, 
_jensen, rosalieper, Scott_WUaS, Wong128hk, Wikidata-bugs, aude, Bawolff, 
He7d3r, Jdforrester-WMF, Mbch331, Rxy, Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Ladsgroup]

Ladsgroup added a comment.


  In T238199#6132487 , 
@ArielGlenn wrote:
  
  > Can we just skip the updateSpecialPages.php wikidatawiki --override 
--only=Fewestrevisions  script altogether, instead of shooting it every month?
  
  That's a product manger decision T245818: Audit query pages on Wikidata 
 and I wouldn't do it unless 
@Lydia_Pintscher is okay with it (otherwise I need to find a way for it to work 
properly).

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, Lydia_Pintscher, Aklapper, 
Ladsgroup, Marostegui, Blissjay007, Oblanco79, Alter-paule, Beast1978, Un1tY, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Kent7301, 
Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, jijiki, Gaboe420, 
Versusxo, Majesticalreaper22, Amorymeltzer, Giuliamocci, Adrian1985, Cpaulf30, 
Imarlier, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, Lsherwinforone, 
GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, 
QZanden, LawExplorer, Sethakill, WSH1906, Lewizho99, Maathavan, elukey, 
_jensen, rosalieper, Scott_WUaS, Wong128hk, Wikidata-bugs, aude, Bawolff, 
He7d3r, Jdforrester-WMF, Mbch331, Rxy, Jay8g, akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[gerritbot]

gerritbot added a comment.


  Change 596172 had a related patch set uploaded (by ArielGlenn; owner: 
ArielGlenn):
  [operations/puppet@production] mediawiki: Disable fewestrevisions for wikidata
  
  https://gerrit.wikimedia.org/r/596172

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, Lydia_Pintscher, Aklapper, 
Ladsgroup, Marostegui, darthmon_wmde, Nandana, jijiki, Amorymeltzer, Imarlier, 
Lahi, Gq86, Lsherwinforone, GoranSMilovanovic, Jayprakash12345, QZanden, 
LawExplorer, Sethakill, elukey, _jensen, rosalieper, Scott_WUaS, Wong128hk, 
Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, Jay8g, 
akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[ArielGlenn]

ArielGlenn added a comment.


  Can we just skip the updateSpecialPages.php wikidatawiki --override 
--only=Fewestrevisions  script altogether, instead of shooting it every month?

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArielGlenn
Cc: ArielGlenn, Lea_Lacroix_WMDE, jcrespo, Addshore, Lydia_Pintscher, Aklapper, 
Ladsgroup, Marostegui, darthmon_wmde, Nandana, jijiki, Amorymeltzer, Imarlier, 
Lahi, Gq86, Lsherwinforone, GoranSMilovanovic, Jayprakash12345, QZanden, 
LawExplorer, Sethakill, elukey, _jensen, rosalieper, Scott_WUaS, Wong128hk, 
Wikidata-bugs, aude, Bawolff, He7d3r, Jdforrester-WMF, Mbch331, Rxy, Jay8g, 
akosiaris
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[jcrespo]

jcrespo added a comment.


  Over 50K user errors: 
https://logstash.wikimedia.org/goto/e78777bdaa039396e05bca8099294c91

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jcrespo
Cc: Lea_Lacroix_WMDE, jcrespo, Addshore, Lydia_Pintscher, Aklapper, Ladsgroup, 
Marostegui, darthmon_wmde, Nandana, Amorymeltzer, Lahi, Gq86, Lsherwinforone, 
GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, Sethakill, _jensen, 
rosalieper, Scott_WUaS, Wong128hk, Wikidata-bugs, aude, Mbch331, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Marostegui]

Marostegui added a comment.


  This hit us hard again:
  
| 1593977753 | wikiadmin   | 10.64.16.77:59698  | wikidatawiki   | 
Query   |   22436 | Copying to tmp table on disk
  | SELECT /* SpecialFewestRevisions::reallyDoQuery  */  
page_namespace AS `namespace`,page_title AS `ti |0.000 |
  
  I have killed it.

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Marostegui
Cc: Lea_Lacroix_WMDE, jcrespo, Addshore, Lydia_Pintscher, Aklapper, Ladsgroup, 
Marostegui, darthmon_wmde, Nandana, Amorymeltzer, Lahi, Gq86, Lsherwinforone, 
GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, Sethakill, _jensen, 
rosalieper, Scott_WUaS, Jonas, Wong128hk, Wikidata-bugs, aude, Mbch331, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2020-04-27T07:15:39Z]  
Kill updateSpecialPages.php wikidatawiki --override --only=Fewestrevisions as 
it is causing lag - T238199 

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: Lea_Lacroix_WMDE, jcrespo, Addshore, Lydia_Pintscher, Aklapper, Ladsgroup, 
Marostegui, darthmon_wmde, Nandana, Amorymeltzer, Lahi, Gq86, Lsherwinforone, 
GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, Sethakill, _jensen, 
rosalieper, Scott_WUaS, Jonas, Wong128hk, Wikidata-bugs, aude, Mbch331, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[jcrespo]

jcrespo added a comment.


  I killed SpecialFewestRevisions::reallyDoQuery because it was causing the 
host (s8, db1101) where it was running to lag for 1-2 seconds, enough for 
queries waiting for replication to take a dive in performance, and logging 
hundreds of thousands of db errors. Long running queries are ok on a vslow 
server, but I wonder if we could make them in smaller batches (slow overal) to 
not tank the writes.

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jcrespo
Cc: jcrespo, Addshore, Lydia_Pintscher, Aklapper, matmarex, Ladsgroup, 
Marostegui, Adidsone1, darthmon_wmde, DannyS712, Nandana, Phukettaxigroup, 
Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, _jensen, 
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238199: SpecialFewestRevisions::reallyDoQuery takes more than 9h to run

[matmarex]

matmarex added a comment.


  @Marostegui Did you mean to CC someone else? I know nothing about this :)

TASK DETAIL
  https://phabricator.wikimedia.org/T238199

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: matmarex
Cc: Lydia_Pintscher, Aklapper, matmarex, Ladsgroup, Marostegui, Adidsone1, 
darthmon_wmde, DannyS712, Nandana, Phukettaxigroup, Lahi, Gq86, 
GoranSMilovanovic, Jayprakash12345, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs