[Wikidata-bugs] [Maniphest] [Updated] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

2017-10-29 Thread BBlack
BBlack added a comment. Now that I'm digging deeper, it seems there are one or more projects in progress built around Push-like things, in particular T113125 . I don't see any evidence that there's been live deploy of them yet, but maybe I'm missing something or other. If we have a live deploy

[Wikidata-bugs] [Maniphest] [Updated] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

2017-10-27 Thread hoo
hoo added a comment. I think I found the root cuase now, seems it's actually related to the WikibaseQualityConstraints extension: F10467699: Screenshot_20171027_145440.png (Permalink: https://grafana.wikimedia.org/dashboard/db/wikidata-quality?panelId=10=1=now-2d=now) See also T173696: Cache

[Wikidata-bugs] [Maniphest] [Updated] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

2017-10-27 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, thiemowmde, aude, Marostegui, Lucas_Werkmeister_WMDE, Legoktm, tstarling, awight,

[Wikidata-bugs] [Maniphest] [Updated] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

2017-10-27 Thread Ladsgroup
Ladsgroup added a comment. @hoo and I sampled x-cache from wberequest dataset for the hour of 19 yesterday for two varnish boxes cp1053 and cp1052. The result is P6199 (NDA'd, better safe than sorry) and could not find anything different.TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL

[Wikidata-bugs] [Maniphest] [Updated] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

2017-10-27 Thread Ladsgroup
Ladsgroup added a project: Traffic. TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Lucas_Werkmeister_WMDE, Legoktm, tstarling, awight, Ladsgroup, Lydia_Pintscher, ori, BBlack, demon, greg,

[Wikidata-bugs] [Maniphest] [Updated] T179156: 503 spikes and resulting API slowness starting 18:45 October 26

2017-10-27 Thread hoo
hoo added a parent task: T174361: 1.31.0-wmf.5 deployment blockers. TASK DETAILhttps://phabricator.wikimedia.org/T179156EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Legoktm, tstarling, awight, Ladsgroup, Lydia_Pintscher, ori, BBlack, demon, greg,